# robots.txt for http://www.rozet.com/ # robots go away User-Agent: crescent User-Agent: teleport User-Agent: emailsiphon User-Agent: wget User-Agent: webzip User-Agent: webcopier User-Agent: psbot User-Agent: extractorpro User-Agent: emailcollector User-Agent: offline User-Agent: emailwolf User-Agent: webbandit User-Agent: webstripper User-Agent: msiecrawler User-Agent: sitesnagger User-Agent: nicerspro User-Agent: website User-Agent: teleportpro User-Agent: GetBot User-Agent: GetWeb Disallow: / # Block access to useless files User-Agent: * Disallow: /popups/ Disallow: /images/ Disallow: /cgi-bin/