# File: robots.txt -Remember the file has to be called robots.txt # Desc: This is the web robot exclusion file. # # Note: More information at: # http://info.webcrawler.com/mak/projects/robots/norobots.html # # Format: # go away User-agent: * Disallow: /