homepage Welcome to WebmasterWorld Guest from 54.226.136.179
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Advertising / Paid Inclusion Engines and Topics
Forum Library, Charter, Moderator: open

Paid Inclusion Engines and Topics Forum

  posting off  
Bizarre Inktomi Behavior looking for things that don't exist on my site
Slurp looked for adult on my site... Is the Inktomi DB corrupted?
Constantin

10+ Year Member



 
Msg#: 2337 posted 3:25 pm on Oct 29, 2003 (gmt 0)

So, I have a bit more time on my hands ever since my Appendix decided to get uppity. On Saturday morning, reconciliation talks reached an feverish impasse and we decided to part ways. Now, I only have a small scar and some pain, which is getting better every day. The Appendix is probably less happy about the outcome.

Anyway, I looked into the Error logs this morning and was struck by the Inktomi barrage my site suffered under last night. Lots and Lots of pages were crawled in quick succession... then there were requests for pages that never have and never will exist on my site.

I was pretty shocked to see requests for these.

Every entry had the standard Slurp UA. I also confirmed that the IP# that correspond to the below requests belong to Inktomi. They came from several different IP# in the IP range, so it's not an isolated server.

In other words, it looks as though Inktomi has suffered from a DB error. The above requests sometimes contain legitimate parts... which makes me think that perhaps they're garbling directory info from site to site.

For example, I have a html file called letter1.html but no directory called iconprecendente, etc.

Anyway, has anyone else seen this?

[edited by: engine at 3:08 pm (utc) on Oct. 30, 2003]
[edit reason] adult specifics removed [/edit]

 

snookie

10+ Year Member



 
Msg#: 2337 posted 3:50 pm on Oct 29, 2003 (gmt 0)

hmm.. I wish Inktomi would index even just one page from my site. If it was there or not...

gibEll

10+ Year Member



 
Msg#: 2337 posted 10:16 pm on Oct 29, 2003 (gmt 0)

Slurp started looking for porn and other pages that have never existed on my site. I hope it enjoyed all of the 404's it got.

Sometimes I think I should just ban that stupid bot.

Stefan

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 2337 posted 2:45 pm on Oct 30, 2003 (gmt 0)

Same deal with me yesterday. Ten 404's in a row as slurp looked for weird combinations of the URI's of my pages and porn sites etc. It was like Ink was having a nervous breakdown.

Glad it wasn't just my site.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Advertising / Paid Inclusion Engines and Topics
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved