User-agent: * Disallow: /cgi-bin Disallow: /downloads Disallow: /filekicker Disallow: /avangate Disallow: /shareit Disallow: /customer Disallow: /custinfo Disallow: /errors Disallow: /email Disallow: /register