homepage Welcome to WebmasterWorld Guest from 54.197.215.146
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Subscribe to WebmasterWorld
Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
u12Bot from Ukraine downloading sites
keyplyr




msg:4664733
 6:39 pm on Apr 21, 2014 (gmt 0)



UA: Mozilla/5.0 (compatible; u12Bot/5.0; +http://u12files.com/)
Referrer: http://u12files.com/
Robots.txt: No

FORMAT-TV-NET-6, Ukraine
91.250.0.0 - 91.250.31.255

Looks like it will rip a site's assets then make it available for download... nice.

 

incrediBILL




msg:4672103
 9:28 pm on May 18, 2014 (gmt 0)

It begs the question why you allow the Ukraine access to your site? They're no better than Romania, Russia and China for bad traffic.

Surprisingly I didn't see that one but that's another reason why I block anything with http:// in the user agent.

Of course the good bots have http:// too but they get through first and the rest get snagged.

keyplyr




msg:4672126
 1:22 am on May 19, 2014 (gmt 0)


It begs the question why you allow the Ukraine access to your site? They're no better than Romania, Russia and China for bad traffic.


Hmmm... I have Ukrainian friends and have had many Ukrainian students in my classes. You can't blame the Ukrainian people for what a few bad agents do... just as I hope they don't blame me for all the USA hackers, plagiarists and thieves.

Just a FYI, the request for u12Bot was blocked with a 403 server response, but not simply because it was Ukrainian.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved