Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

Altavista crawl

Big Altavista-crawl no visitors



2:59 pm on May 26, 2003 (gmt 0)

10+ Year Member

With a programm called Spydertrax i noticed that " Altavista 24 May 2003
14:01:00 Scooter/3.2 trek28.sv.av.com " Spidered my site 404 times today....

Since i do not get any traffic from Altavista i am wondering if this maybe could be a first deep crawl from Altavista.... My site is running good on Google though, so i guess keywords etc are in order...

Anyone ever noticed something like this?


3:25 pm on May 26, 2003 (gmt 0)

10+ Year Member

Scooter indexes lots of sites on a regular basis, and can get quite aggressive (several url requests per second). If it is the first time it has visited you, it will come back. Often.

But do not expect much traffic out of this. When you see the traffic it brings, you can then decide whether the traffic compensates for the bandwidth and server capacity Scooter consumes.

People often let Scooter do anything it wants, as if they expected old AV times to come back. I don't (certainly not in the short run).


3:29 pm on May 26, 2003 (gmt 0)

10+ Year Member

Thanks for sharing, i will look at it untill end of next month ... If it costs more then it brings me it's astalavista baby!

Okay my site had a massive crawl from Altavista, but when do they index my site... I cant find all the crawled pages now in altavista ...


Featured Threads

Hot Threads This Week

Hot Threads This Month