homepage Welcome to WebmasterWorld Guest from 54.237.213.31
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
HTMLParser/1.6
from research27.corp.sp1.yahoo.com
blend27

WebmasterWorld Senior Member 5+ Year Member



 
Msg#: 3411305 posted 10:05 am on Aug 2, 2007 (gmt 0)

what is this thing?

 

wilderness

WebmasterWorld Senior Member wilderness us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 3411305 posted 2:07 pm on Aug 2, 2007 (gmt 0)

top of the list google

[google.com...]

blend27

WebmasterWorld Senior Member 5+ Year Member



 
Msg#: 3411305 posted 7:30 pm on Aug 2, 2007 (gmt 0)

I see.

The reason I Ask that it is comming from Yahoo Range

So far

68.180.144.39
68.180.144.40
68.180.144.41
68.180.144.42

It does not ask for robots.txt, and the interesting part that is asks for the same files, content pages only that rank on page one in Y! SERP.

One of the files it is asking for does not have links from with in the site for at least 2 years(product is out of stock). the only links that are pointing to this URI are from old MFAs.

Anybody else has this issue?

bobothecat



 
Msg#: 3411305 posted 8:43 pm on Aug 2, 2007 (gmt 0)

Anybody else has this issue?

Me too... and can't figure out for the life of me why they're doing it.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved