User-agent: *
Crawl-delay: 10

User-agent: *
Disallow: /browse-author
Disallow: /items-by-author
Disallow: /browse-date
Disallow: /browse-subject
Disallow: /bitstream