Welcome to WebmasterWorld Guest from 22.214.171.124 , register , free tools , login , search , subscribe , help , library , announcements , recent posts , open posts Subscribe and Support WebmasterWorld
Altavista crawl Big Altavista-crawl no visitors izigo msg:25835 2:59 pm on May 26, 2003 (gmt 0) With a programm called Spydertrax i noticed that " Altavista 24 May 2003 14:01:00 Scooter/3.2 trek28.sv.av.com 126.96.36.199 " Spidered my site 404 times today....
Since i do not get any traffic from Altavista i am wondering if this maybe could be a first deep crawl from Altavista.... My site is running good on Google though, so i guess keywords etc are in order...
Anyone ever noticed something like this?
starec msg:25836 3:25 pm on May 26, 2003 (gmt 0)
Scooter indexes lots of sites on a regular basis, and can get quite aggressive (several url requests per second). If it is the first time it has visited you, it will come back. Often.
But do not expect much traffic out of this. When you see the traffic it brings, you can then decide whether the traffic compensates for the bandwidth and server capacity Scooter consumes.
People often let Scooter do anything it wants, as if they expected old AV times to come back. I don't (certainly not in the short run).
izigo msg:25837 3:29 pm on May 26, 2003 (gmt 0)
Thanks for sharing, i will look at it untill end of next month ... If it costs more then it brings me it's astalavista baby!
Okay my site had a massive crawl from Altavista, but when do they index my site... I cant find all the crawled pages now in altavista ...