User-agent: * Disallow: /cgi-bin Disallow: /scgi-bin Disallow: /assets/phpScripts Disallow: /assets/go Disallow: /assets/js Disallow: /assets/css Disallow: /test