User-agent: GoogleBot Disallow: *.tar Disallow: *.gz Disallow: *.bz2 Disallow: *.tgz Disallow: *.tbz Disallow: *.7z User-agent: * Disallow: /cgi-bin/ Disallow: /man Disallow: /tmp/ Disallow: /share/ Disallow: /FlashGames Disallow: /private Disallow: /virtual_ Crawl-delay: 3 Request-rate: 5/4 Visit-time: 1500-2300 # some robots jerk can not be asked politely # we have to eventually reject /share/ for all