homepage Welcome to WebmasterWorld Guest from 54.166.159.110
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
NerdByNature.Bot
incrediBILL

WebmasterWorld Administrator incredibill us a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month



 
Msg#: 4477755 posted 7:45 am on Jul 21, 2012 (gmt 0)

I have no clue why this thing crawls except to get curious webmasters to go to their website as it has no real purpose best I can tell.

176.9.9.81

Mozilla/5.0 (compatible; NerdByNature.Bot; http://www.nerdbynature.net/bot)

robots.txt: YES

 

keyplyr

WebmasterWorld Senior Member keyplyr us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4477755 posted 7:57 am on Jul 21, 2012 (gmt 0)


hetzner/your-server.de
176.9.0.0 - 176.9.0.3
176.9.0.0/16

lucy24

WebmasterWorld Senior Member lucy24 us a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month



 
Msg#: 4477755 posted 4:48 pm on Jul 21, 2012 (gmt 0)

Good heavens, Bill, even I block Hetzner (176.9). Notes say "too many robots to track".

If you've got a robot that will cure cancer and end world hunger, better find it a home somewhere else ;)

incrediBILL

WebmasterWorld Administrator incredibill us a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month



 
Msg#: 4477755 posted 7:03 pm on Jul 21, 2012 (gmt 0)

Good heavens, Bill, even I block Hetzner


So do I, this is from my bounced bots report.

Just because I bounce them doesn't mean I'm not curious what they do.

keyplyr

WebmasterWorld Senior Member keyplyr us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4477755 posted 9:01 pm on Jul 21, 2012 (gmt 0)


I got tired of bouncing them. I just block them now.

incrediBILL

WebmasterWorld Administrator incredibill us a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month



 
Msg#: 4477755 posted 10:33 pm on Jul 21, 2012 (gmt 0)

Bounce vs. block?

Please explain ;)

keyplyr

WebmasterWorld Senior Member keyplyr us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4477755 posted 11:41 pm on Jul 21, 2012 (gmt 0)

In my vernacular, the term "bounce" refers to bouncing the requests from one server to a separate (usually remote) server using a variety of methods including forwarding techniques.

"Block" would refer to a simple deny, using any method of choice and not bouncing the request anywhere else.

However my statement was more an attempt at humor than a strategic contribution.

incrediBILL

WebmasterWorld Administrator incredibill us a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month



 
Msg#: 4477755 posted 1:06 am on Jul 22, 2012 (gmt 0)

ah ha! attempted humor?

KNOCK KNOCK ROBOTS.TXT
Who's there?
NerdByNature.Bot
Disallow: /

KNOCK KNOCK INDEX.HTML
Who's there?
NerdByNature.Bot
403 Forbidden

KNOCK KNOCK
Who's there?
Mozilla
Mozilla who?
Mozilla who use NerdByNature.Bot's IP
403 Forbidden
Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved