Welcome to WebmasterWorld Guest from 188.8.131.52 , register , free tools , login , search , pro membership , help , library , announcements , recent posts , open posts Pubcon Platinum Sponsor 2014
Inktomi Spider Has a Party Spider visits out the roof snark msg:16288 1:01 am on Nov 26, 2003 (gmt 0) Three weeks ago, a site I manage was visited by Inktomi's spiders 213 times. Two weeks ago, 977 visits. But last week, Inktomi came visiting a whopping 4,399 times.
Anybody else notice this?
jimbeetle msg:16289 10:49 pm on Nov 29, 2003 (gmt 0)
Yep, Ink appears to be real busy this month. The last I checked a couple of days ago it slurped up about 2,300 pages on a 1,500 page site. It also did pretty well in October with 1,700 pages but seems to be a bit hungrier of late. snark msg:16290 3:41 am on Dec 4, 2003 (gmt 0)
Yeah -- I also noticed a huge increase in visits on other sites I manage. Well, I hope I get some good listings from it. :D pendanticist msg:16291 4:02 am on Dec 4, 2003 (gmt 0)
I still see slurp asking for files I've never had.
I still see slurp asking for files that I 301'd
lastyear. Most of the other bots have moved on, but not slurp.
panic msg:16292 6:12 pm on Dec 5, 2003 (gmt 0)
I have a fairly new site, and it doesn't look like Ink has been making too many frequent trips to my site lately. I've only gotten 6 visits from Inktomi this month :( jimbeetle msg:16293 6:55 pm on Dec 5, 2003 (gmt 0)
I still see slurp asking for files that I 301'd lastyear.
Same here, more than 12 months since I did a major overhaul in one section and Ink still hasn't gotten the word though it has requested those file numerous times and got the proper 301.
Have more reorganization in mind but putting it off until I can slim down my htaccess a bit before adding more entries.