# robots.txt 
User-agent: *
Disallow: /cgi-bin/
Disallow: /restricted_crawl/
Sitemap: http://www.centosharp.com/sitemap.xml