# robots.txt # disallows search bots from crawling specific folders User-agent: * Disallow: /labs/ Disallow: /dokuwiki/ Disallow: /forum/ Disallow: /detag/ Disallow: /phpBB3/ Disallow: /phpBB2/ Disallow: /kevin/ Disallow: /a_special/ Disallow: /cal/ Disallow: /gdc/ Disallow: /wp-content/