# robots.txt www.gooster.fr User-agent: * Disallow: /js/ Disallow: /nav/ Disallow: /search.htm Disallow: /if/ Disallow: /ifr/ Disallow: /opinions/ Disallow: /log/ User-agent: Xenu's Link Sleuth 1.1c Disallow: / User-agent: Xenu's Disallow: / User-agent: Xenu Link Sleuth 1.2e Disallow: /