User-agent: * #directed to all spiders Disallow: /cgi-bin Disallow: /_private Disallow: /_vti_bin Disallow: /_vti_pvt Disallow: /_vti_text Disallow: /_vti_log Disallow: /buttons Disallow: /css Disallow: /images