homepage Welcome to WebmasterWorld Guest from 23.22.2.150
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Pingo?
The pingo spider
johnwards

10+ Year Member



 
Msg#: 3038 posted 2:59 pm on Oct 18, 2005 (gmt 0)

Just spotted this spider, it requests robots.txt.

Since the 11th of october i've been spidered 2460 times..excluding hits to robots.txt.

The i.p. address seems to belong to a company called whereonearth.com limited.

Anyone know anything about them thats not on their site?

 

spekiehl

10+ Year Member



 
Msg#: 3038 posted 5:08 pm on Nov 8, 2005 (gmt 0)

My site just got hammered by Pingo. Looks like WhereOnEarth is a yahoo company which develops local search technology. They just acquired the company in late october. I'm quite impressed by how efficient and organized this bot seems to be. It when through the main indexes on my site and then went to each individual information page. It only seems to go 2 to 3 deep within a page-thru listing.

bobothecat



 
Msg#: 3038 posted 11:50 pm on Nov 8, 2005 (gmt 0)

Could you post the whole UA?

wilderness

WebmasterWorld Senior Member wilderness us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 3038 posted 12:36 am on Nov 9, 2005 (gmt 0)

This thingy hasn't been to my sites.

A saw a couple of referecne to Pingo and Red Hat.

Here' a google on 3.0

[google.com...]

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved