# this is simply a script that tells all robots, spiders and agents to help themselves. User-agent: * Disallow: # to turn it all off use the follerin # User-agent: * # Disallow: /