# robots.txt # Robot-exclusion file for DAC cohosted domains # Please contact webmaster@conbio.rice.edu when making additions. # See: http://info.webcrawler.com/mak/projects/robots/norobots.html User-agent: * # ROOT DIRECTORY EXCLUSIONS FOLLOW Disallow: /Summer97/ Disallow: /summer97/ Disallow: /test/ Disallow: /cf2docs/ Disallow: /cf3docs/ Disallow: /cfdocs/ # GLOBAL DIRECTORY EXCLUSIONS FOLLOW Disallow: Admin/ Disallow: Dev/ Disallow: New/ Disallow: Stats/ Disallow: Tools/ Disallow: admin/ Disallow: dev/ Disallow: new/ Disallow: stats/ Disallow: tools/ Disallow: Survey/ Disallow: kb/ Disallow: krist/ Disallow: bboard/