# /robots.txt file for http://www.cert.org/ # email webmaster@cert.org for questions # Allow all crawlers, but help them avoid redundant # or unindexable content directories # User-agent: * Disallow: /technicalsymposium/ Disallow: /cgi-bin/ Disallow: /ftp/cert_advisories/ Disallow: /ftp/tech_tips/ Disallow: /ftp/tools/ Disallow: /include/ Disallow: /images/ Disallow: /gifs/