User-agent: * Disallow: /admin Disallow: /App_ Disallow: /aspnet_client/ Disallow: /bin/ Disallow: /cgi-bin/ Disallow: /files/ Disallow: /images/ Disallow: /members/ Disallow: /private/ Disallow: /scripts/ Disallow: /search Disallow: /Web User-agent: asterias Disallow: / User-agent: Googlebot-Image Disallow: / User-agent: ia_archiver Disallow: / User-agent: psbot Disallow: / User-agent: Yahoo-Blogs Disallow: / User-agent: Yahoo-MMCrawler Disallow: /