# This file specifies areas of the Web hierarchy that robots (webcrawler, etc.) # should stay out of. # # For more information, see # http://info.webcrawler.com/mak/projects/robots/robots.html # User-agent: * Disallow: /caucus/ Disallow: /caucusguest/ Disallow: /sweb/ Disallow: /swebguest/ Disallow: /cgi-bin/ Disallow: /soft-cgi/