homepage Welcome to WebmasterWorld Guest from 54.163.72.86
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
HTMLParser/1.6
from research27.corp.sp1.yahoo.com
blend27




msg:3411307
 10:05 am on Aug 2, 2007 (gmt 0)

what is this thing?

 

wilderness




msg:3411445
 2:07 pm on Aug 2, 2007 (gmt 0)

top of the list google

[google.com...]

blend27




msg:3411863
 7:30 pm on Aug 2, 2007 (gmt 0)

I see.

The reason I Ask that it is comming from Yahoo Range

So far

68.180.144.39
68.180.144.40
68.180.144.41
68.180.144.42

It does not ask for robots.txt, and the interesting part that is asks for the same files, content pages only that rank on page one in Y! SERP.

One of the files it is asking for does not have links from with in the site for at least 2 years(product is out of stock). the only links that are pointing to this URI are from old MFAs.

Anybody else has this issue?

bobothecat




msg:3411937
 8:43 pm on Aug 2, 2007 (gmt 0)

Anybody else has this issue?

Me too... and can't figure out for the life of me why they're doing it.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved