homepage Welcome to WebmasterWorld Guest from 54.204.107.48
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Ipod, Ipad Iphone user agents
Any bad conduct coming from such UAs
slipkid



 
Msg#: 4569949 posted 8:55 am on May 2, 2013 (gmt 0)

I am sure we have all noticed that hits to our sites are increasingly showing a greater number of the above-referenced mobile device UAs.

From time to time I grab a number of these UAs and check their IPs to see if they are scraper/scammers, etc.

To date, I have yet to find a bad guy.

Are my efforts to identify scrapers with such UAs poorly done, or is this rather fertile field for scrapers not yet being used to any significant extent?

 

keyplyr

WebmasterWorld Senior Member keyplyr us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4569949 posted 4:48 pm on May 2, 2013 (gmt 0)

Scraper can come from any IP range. They can (and do) come from mobile carrier ranges spoofing mobile device UAs.

Best to check headers. Those are often screwed-up.

slipkid



 
Msg#: 4569949 posted 3:12 am on May 3, 2013 (gmt 0)

Thanks for your advice.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved