homepage Welcome to WebmasterWorld Guest from 54.226.161.112
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Advertising / Paid Inclusion Engines and Topics
Forum Library, Charter, Moderators: Brett Tabke

Paid Inclusion Engines and Topics Forum

  posting off  
Inktomi Spider Has a Party
Spider visits out the roof
snark




msg:16288
 1:01 am on Nov 26, 2003 (gmt 0)

Three weeks ago, a site I manage was visited by Inktomi's spiders 213 times. Two weeks ago, 977 visits. But last week, Inktomi came visiting a whopping 4,399 times.

Anybody else notice this?

 

jimbeetle




msg:16289
 10:49 pm on Nov 29, 2003 (gmt 0)

Yep, Ink appears to be real busy this month. The last I checked a couple of days ago it slurped up about 2,300 pages on a 1,500 page site. It also did pretty well in October with 1,700 pages but seems to be a bit hungrier of late.

snark




msg:16290
 3:41 am on Dec 4, 2003 (gmt 0)

Yeah -- I also noticed a huge increase in visits on other sites I manage. Well, I hope I get some good listings from it. :D

pendanticist




msg:16291
 4:02 am on Dec 4, 2003 (gmt 0)

I still see slurp asking for files I've never had.

I still see slurp asking for files that I 301'd lastyear. Most of the other bots have moved on, but not slurp.

Maybe someday.......

<shrug>

Pendanticist.

panic




msg:16292
 6:12 pm on Dec 5, 2003 (gmt 0)

I have a fairly new site, and it doesn't look like Ink has been making too many frequent trips to my site lately. I've only gotten 6 visits from Inktomi this month :(

jimbeetle




msg:16293
 6:55 pm on Dec 5, 2003 (gmt 0)

I still see slurp asking for files that I 301'd lastyear.

Same here, more than 12 months since I did a major overhaul in one section and Ink still hasn't gotten the word though it has requested those file numerous times and got the proper 301.

Have more reorganization in mind but putting it off until I can slim down my htaccess a bit before adding more entries.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Advertising / Paid Inclusion Engines and Topics
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved