User-agent: * Disallow: /clients Disallow: /include Disallow: /include/js Disallow: /include/css Disallow: /include/img Disallow: s1.php User-agent: Slurp Disallow: /cgi-bin/