# Robot Exclusion File -- robots.txt # Author: Simon Ruddy # www.gynogapod.co.uk User-Agent: * Disallow: /css/ Disallow: /includes/ Disallow: /links/ Disallow: /modules/ User-agent: Googlebot-Image Disallow: / User-agent: ia_archiver Disallow: / User-agent: psbot Disallow: /