User-agent: * Crawl-delay: 10 Request-rate: 1/5 # maximum rate is one page every 5 seconds Disallow: /cgi-bin/ Disallow: /images/ Disallow: /*_images/ Disallow: /*_resume/ Disallow: /*_documents/ Disallow: /temp/ Disallow: /subdomain/ Disallow: /test*/ Disallow: /tinyMCE/