User-agent: * Disallow: /cgi-bin/ Disallow: mailto: *@*.* User-agent: *httrack* Disallow: *.* Disallow: /* User-agent: *offline* Disallow: *.* Disallow: /*