Forum Moderators: open
Thanks for the input. Anybody got anything else on Slurp/si? Is it just a link checker and 404 remover as Pete says?
BTW Pete I think the Slurp/so is the spider for Goo or I am led to beleive that by the following post.
Slurp/so [webmasterworld.com]
Please look at Littleman's post to me.
LMK :)
Regards
Dr. Bill
2) Sat Sep 3 18:46:29 2000 --¦Slurp/cat (slurp@inktomi.com;http://www.inktomi.com/slurp.html)¦216.35.116.108
30 Sat Sep 4 18:46:44 2000 --¦Slurp/cat (slurp@inktomi.com;http://www.inktomi.com/slurp.html)¦216.35.116.108
My point here is notice the time and date, what is the purpose of spidering (same page all three times btw) almost exactly 24 hours apart?