Page is a not externally linkable
zooros - 8:34 pm on Dec 9, 2003 (gmt 0)
right now altavistas crawlers are consuming several hundred here are the crawler id's/UA's: any ideas? (or promises from altavista? :)
altavista is not only back in my logfiles -
their crawlers actually consume more than 85% of my
traffic - grabbing the same (huge) multimedia files
over and over.
gigabytes. is anyone seeing the same? although i like altavista - if they continue im afraid that i have to ban their robots - the traffic they cause doesnt hold against the few referrals from this search engine (although i cant complain about the rankings ...)
mmsorbet1.sv.av.com
mmsorbet11.sv.av.com
mmsorbet13.sv.av.com
mmsorbet14.sv.av.com
mmsorbet15.sv.av.com
mmsorbet16.sv.av.com
mmsorbet2.sv.av.com
mmsorbet20.sv.av.com
mmsorbet22.sv.av.com
mmsorbet24.sv.av.com
mmsorbet25.sv.av.com
mmsorbet28.sv.av.com
mmsorbet29.sv.av.com
mmsorbet3.sv.av.com
mmsorbet31.sv.av.com
mmsorbet32.sv.av.com
mmsorbet34.sv.av.com
mmsorbet35.sv.av.com
mmsorbet36.sv.av.com
mmsorbet38.sv.av.com
mmsorbet39.sv.av.com
mmsorbet4.sv.av.com
mmsorbet5.sv.av.com
mmsorbet7.sv.av.com
mmsorbet8.sv.av.com