User-agent: * Disallow: /assets/* Disallow: /cgibin/ Disallow: /user/*