# Google crawler (see http://www.google.com/support/webmasters/) User-Agent: Googlebot Disallow: /prdcons/ # Yahoo crawler (see http://help.yahoo.com/l/us/yahoo/search/webcrawler/) User-agent: Slurp Disallow: /prdcons/ # All the rest User-agent: * Disallow: /prdcons/ Crawl-delay: 120