# # robots.txt for http://www.w3.org/ # # $Id: robots.txt,v 1.20 2000/11/23 00:54:15 gerald Exp $ # # exclude some access-controlled areas User-agent: * Disallow: /Abstimmung/ Disallow: /Bilder/ Disallow: /cgi-bin/Anyboad(V83) Disallow: /cgi-bin/NichtAufServer Disallow: /Downloads/Intern/ Disallow: /DFLD/IntMess/ Disallow: /DFLD/IntMitglied/ Disallow: /DFLD/Vorstand/ Disallow: /Forum/ Disallow: /FTP/ Disallow: /JP-Graph/ Disallow: /Log/ Disallow: /MMhtml/ Disallow: /PFV_Landebahn/EOeT-PFV/ Disallow: /Presse/Andere Disallow: /Presse/Andere0 Disallow: /Presse/AndereF Disallow: /Presse/AndereV Disallow: /Presse/Briefe Disallow: /Presse/FAZ Disallow: /Presse/FR Disallow: /Presse/HK Disallow: /Presse/Private Disallow: /Presse/Rest Disallow: /Presse/WK Disallow: /Prv/ Disallow: /RDF/ Disallow: /Root/ Disallow: /Scratch/ Disallow: /Software/ Disallow: /Technik/ Disallow: /Temp/ Disallow: /Upload/