User-agent: * Disallow: /crf/phone/3com/ Disallow: /CAVE/private Disallow: /CAVE/exclude Disallow: /CAVE/phpadmin Disallow: /nlp/newsblaster/archives/ Disallow: /?plugin=attach&pcmd=open&file=* Disallow: /mice Disallow: /crftest Disallow: /crfnew Disallow: /crf/support_charge.shtml Disallow: /webtest Disallow: /~cs3157/cs3157_grades.xlsx User-agent: Slurp Crawl-delay: 10