Interruption to Scooter

would it stop crawling now?

[daesasitorn]

Scooter has been crawling my site in the last few days and only going through about 10% of the site (of about 10,000 pages. yesterday the site had four hours interruption because of my very stupid error. I was in such a hurry and set a password protection directory for our client and mistakenly it was set for the entire site! I am just so worried that the scooter was there at the time (very likely so), and it now stops crawling the rest of the site and it will be a real horror to me to see 3,800 pages listed with Altavista reduced to a few hundreds. Do you think they will try again? I wrote to them this morning and doubt it very much that it would do any good.

[seth_wilde]

I'm sure they'll try again... it's just a matter of when. They've been pretty good about updating lately so hopefully your wait won't be too long..

[daesasitorn]

Thanks...I do hope so. If it is google, I will not worry too much because they update very often. With Altavista, I did the free five urls submission with them in April 2001 and only got listed in Feb 2002 and since then the entire site was updated only once. If they are going the same rate, it could well be next year before I have all pages back on the list again!!

[korkus2000]

Are you recieving good traffic from AV? I get scooter constantly. I bearly see any traffic but my listings are updated pretty often. I got in for free.

[daesasitorn]

The traffic from them is not great, but in the last few months, I can see that it is increasing and I also noticed that the results in their search engine has improved a lot, so I am very sure that being with them is very important. Out of about 700 visitors a day, we have about 30 from them and only 15 from Lycos and Alltheweb together, and the rest mostly are from Google.