# robots control file, /robots.txt # Robots are free to roam - we do have a problem with very fast # robots spamming cgi-bin scripts - don't do it or you will be # in violation of Federal computer tampring laws. # no archive copies User-agent: ia_archiver Disallow: / # everybody else ok, except cgi-bin User-agent: * Disallow: /cgi-bin Disallow: /honeypot