# robots.txt for http://www.droitwichrfc.co.uk/

User-agent: *
Disallow: /gallery/
Disallow: /news/2010/
Disallow: /news/2009/
Disallow: /news/2008/
Disallow: /news/2007/
Disallow: /news/2006/
Disallow: /news/2005/
Disallow: /news/2004/
Disallow: /news/2003/

User-agent: slurp
Crawl-delay: 2400