homepage Welcome to WebmasterWorld Guest from 54.204.90.135
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Ukranian Colocation
Utel DataCenter, Ukraine (RIPE)
Bewenched




msg:4514005
 1:17 am on Oct 31, 2012 (gmt 0)

Network: 213.186.112.0/20
Address: 213.186.112.0
Netmask: 255.255.240.0 = 20

caught this one sniffing around today. Boy these guys are getting bad. If we didn't have Russian customers I'd block the whole country.

 

incrediBILL




msg:4514060
 6:01 am on Oct 31, 2012 (gmt 0)

Unless you do business with them you're better off blocking the Ukraine, Romania, Russia, etc.

lucy24




msg:4514070
 6:44 am on Oct 31, 2012 (gmt 0)

Oh, hey, I've got those blocked already :) Assorted robots, notably including ahrefs whose distinctive behavior pattern is to first pick up pages and then get robots.txt. Presumably followed by "Darn! I could have got robots.txt in the first place and made myself look good. None of those pages was disallowed anyway."

I wouldn't have the heart to block Russia. Sometimes I get people from Yandex looking for pictures of rats ;)

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved