User-agent: * Disallow: /go/ Disallow: /scripts/ Disallow: /products/ Disallow: /frontpage/ Disallow: /posts_ajax/ Disallow: /login/