homepage Welcome to WebmasterWorld Guest from 54.198.140.182
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
eBay UK Crawling?
or just a browser thing
incrediBILL




msg:4477754
 7:39 am on Jul 21, 2012 (gmt 0)

Had these 2 hits in a second of each other, not sure what to make of it coming supposedly from eBay in the UK.

ROBOTS_TXT,193.28.178.13,"Mozilla/5.0 (Windows NT x.y; Win64; x64; rv:10.0.1) Gecko/20100101 Firefox/10.0.1","/robots.txt"

DISALLOWED,193.28.178.13,"Mozilla/5.0 (Windows NT x.y; Win64; x64; rv:10.0.1) Gecko/20100101 Firefox/10.0.1","/index.html"


inetnum: 193.28.178.0 - 193.28.178.255
netname: EBAY-DUBLIN-NET
descr: ebay Inc.
descr: San Jose, California 95125
country: GB

Any ideas?

 

wilderness




msg:4477797
 12:28 pm on Jul 21, 2012 (gmt 0)

Bill,
EBay in NA used to crawl from 216.113.181.zz which was a real PITA at the time (2008).

I've a nagging recollection that I saw a Euro ebay however unable to locate any saved reference.

dstiles




msg:4477916
 10:25 pm on Jul 21, 2012 (gmt 0)

I have that IP range blocked for ebay as of May 2010 so it must have hit me then, otherwise I wouldn't have bothered.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved