homepage Welcome to WebmasterWorld Guest from 184.73.104.82
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Zeerch
Angonasec

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 4636285 posted 1:15 am on Jan 10, 2014 (gmt 0)

Discovered ignoring our valid robots.txt directives.

[zeerch.com...]

Q/
Where is Zeerch Search Located?
Zeerch is everywhere. We have servers in multiple countries. We are determined to have our existence in almost every country soon.
/Q

Oh dear.

Q/
In processing, Allow and Disallow paths prior to March, 2013, ZeerchBot did not understand * or $ in these paths.
/Q

Zeerch Bot is steadfastly visiting and still ignoring robots.

Nuff sed. Blocked on UA.

 

dstiles

WebmasterWorld Senior Member dstiles us a WebmasterWorld Top Contributor of All Time 5+ Year Member



 
Msg#: 4636285 posted 8:11 pm on Jan 10, 2014 (gmt 0)

> Blocked on UA

Which is?

bobothecat2



 
Msg#: 4636285 posted 8:42 pm on Jan 10, 2014 (gmt 0)

A CIDR range would be most helpful too.

lucy24

WebmasterWorld Senior Member lucy24 us a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month



 
Msg#: 4636285 posted 9:00 pm on Jan 10, 2014 (gmt 0)

The linked page (OP) says

Mozilla/5.0 (compatible; ZeerchBot; +http://www.Zeerch.com/bot.php)

The quoted text (OP) says, in paraphrase, "Don't bother blocking by IP unless you want to spend your life playing whack-a-mole".

bobothecat2



 
Msg#: 4636285 posted 9:00 pm on Jan 10, 2014 (gmt 0)

After doing a little searching, they claim that their UA is:

Mozilla/5.0 (compatible; ZeerchBot; +http://www.Zeerch.com/bot.php)

Though I've also seen references to:

Mozilla/5.0 (compatible; ZB-1; +http://www.zeerch.com/bot.php)

Zeerch itself seems to be hosted on PEAK10 (63.247.128.0/20), which I already have blocked, but I also see references of the bot coming from the 110.164.208.0/20 range, specifically 110.164.210.6 - which is TH and I already have that entire Country blocked.

Angonasec

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 4636285 posted 2:01 am on Jan 11, 2014 (gmt 0)

Lucy's got it, the minisculed link in the first post contains sufficient gen.

keyplyr

WebmasterWorld Senior Member keyplyr us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4636285 posted 9:17 am on Jan 11, 2014 (gmt 0)


I think this "search engine" is BS. I tried several generic searches resulting in 0 results. Me thinks they are crawling for other reasons - blocked.

lucy24

WebmasterWorld Senior Member lucy24 us a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month



 
Msg#: 4636285 posted 10:45 am on Jan 11, 2014 (gmt 0)

How Zeerch Bot often Crawls a Site

I don't suppose this was intended to be funny. But it is :)

Zeerch is a private held company with great people and ambitions of bringing back the way searching should be. The two founders behind Zeerch are {one Anglo name}. & {another Anglo name}. Everyone else is kept secret for the moment.

Something doesn't add up here.

Zeerch is a registered trademark with the United States Patent and Trademark Office.

This is --surprise!-- true [tess2.uspto.gov].

Angonasec

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 4636285 posted 6:30 pm on Jan 11, 2014 (gmt 0)

Ve hav vays of making you Zeerch!

Q/
Zeerch is everywhere. We have servers in multiple countries.
/Q

What they call a "server" may well be a botnet.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved