Scooter (Altavista) spider 216.39.50.144, comes to our site every couple days, but it only goes to our index page. Any ideas why it doesn't go further?
Thanks!
nfinland
6:09 am on Apr 15, 2003 (gmt 0)
I had have the same problem - Itīs very slow in indexing the hole site. I have a site that has been online since middle of 2001. Altavista has indexed 20 % of the pages only :-(
You should also optimize your index page in a way that spiders has easy acces to your other pages!
