User-agent: * Disallow: /modelinks/ User-agent: * Disallow: /click/ User-agent: * Disallow: /spider-trap User-agent: googlebot Disallow: /spider-trap User-agent: wget User-agent: webzip User-agent: webmirror User-agent: webcopy Disallow: /cgi-bin/ User-agent: * Disallow: /category/ User-agent: googlebot Disallow: /category/