#****************************************************************************** # # Control access by search engines, crawlers, spiders, or robots. This # file must be named robots.txt in the root directory of the web site. # # mm/dd/yy xxx Comments on the changes go here. # 11/24/00 MK Created # #****************************************************************************** User-agent: * # Affects all robots Disallow: /~ # User directories Disallow: /%7E # Escaped User directories Disallow: /CVS/ # Internal support Disallow: /admin-log/ # Internal support Disallow: /archives/ # Mailing list archives Disallow: /backup # Maintenance Disallow: /images/ # Images Disallow: /incoming/ # Maintenance Disallow: /frags/ # Maintenance Disallow: /junk # Maintenance Disallow: /test/ # Maintenance