# Robots.txt file from http://www.searchengineworld.com User-agent: * Disallow: /CGI_BIN/ Disallow: /forms/ Disallow: /Dbase/ Disallow: /search/ Disallow: /logfiles/