Welcome to WebmasterWorld Guest from 23.22.79.235

Forum Moderators: open

Message Too Old, No Replies

Altavista crawl

Big Altavista-crawl no visitors

   
2:59 pm on May 26, 2003 (gmt 0)

10+ Year Member



With a programm called Spydertrax i noticed that " Altavista 24 May 2003
14:01:00 Scooter/3.2 trek28.sv.av.com 216.39.48.72 " Spidered my site 404 times today....

Since i do not get any traffic from Altavista i am wondering if this maybe could be a first deep crawl from Altavista.... My site is running good on Google though, so i guess keywords etc are in order...

Anyone ever noticed something like this?

3:25 pm on May 26, 2003 (gmt 0)

10+ Year Member



Scooter indexes lots of sites on a regular basis, and can get quite aggressive (several url requests per second). If it is the first time it has visited you, it will come back. Often.

But do not expect much traffic out of this. When you see the traffic it brings, you can then decide whether the traffic compensates for the bandwidth and server capacity Scooter consumes.

People often let Scooter do anything it wants, as if they expected old AV times to come back. I don't (certainly not in the short run).

3:29 pm on May 26, 2003 (gmt 0)

10+ Year Member



Thanks for sharing, i will look at it untill end of next month ... If it costs more then it brings me it's astalavista baby!

Okay my site had a massive crawl from Altavista, but when do they index my site... I cant find all the crawled pages now in altavista ...