Welcome to WebmasterWorld Guest from 184.73.126.70

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

Yellow Pages bot impersonating Googlebot?

   
12:16 am on Apr 20, 2011 (gmt 0)



I just saw this on my log:

64.209.132.4 - - [19/Apr/2011:04:37:59 -0400] "GET /filename.html HTTP/1.1" 403 380 "-" "YPBot/Raven1.1.3 (compatible; Googlebot/2.1;+http://www.yellowpages.com/about/legal/crawl)"

Yellow Pages IP with both their bot and Googlebot names...?

Do the yellow pages and google have a partnership?

What is going on...should I allow them access?

Any advice would be appreciated.
7:00 am on Apr 20, 2011 (gmt 0)

WebmasterWorld Senior Member topr8 is a WebmasterWorld Top Contributor of All Time 10+ Year Member



anything calling itself googlebot that doesn't pass a reverse dns test gets blocked by us.
1:08 am on Apr 21, 2011 (gmt 0)



I blocked them, but thought it was very odd that a relatively mainstream company would attempt to pull a fast one.
9:41 am on Apr 25, 2011 (gmt 0)

WebmasterWorld Senior Member topr8 is a WebmasterWorld Top Contributor of All Time 10+ Year Member



... actually there is no hostname associated with the ip address you gave ...

quite possibly not yellow pages either!
10:52 am on Apr 25, 2011 (gmt 0)

WebmasterWorld Administrator phranque is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



Yellowpages.com SAVV-S265785-1 (NET-64-209-132-0-1) 64.209.132.0 - 64.209.132.255
1:14 pm on Apr 25, 2011 (gmt 0)

WebmasterWorld Senior Member topr8 is a WebmasterWorld Top Contributor of All Time 10+ Year Member



ok so it is yellow pages, but no hostname set up!
7:14 pm on Apr 25, 2011 (gmt 0)

WebmasterWorld Senior Member dstiles is a WebmasterWorld Top Contributor of All Time 5+ Year Member



I have no bot recorded as having come from that range and certainly not a googlebot, which would get rejected on that IP range, or a YP bot.

There is no rDNS, as topr8 mentions, so it's due a blocking.

The parent of that IP range is Savvis, which is worth blocking anyway.
6:11 pm on Jul 15, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Got a visit today from 208.93.105.250 - null.ev1.yellowpages.com
YPBot/Raven1.1.3 (compatible; Googlebot/2.1; http: //www.yellowpages.com/about/legal/crawl)

Took robots.txt and left, well good luck to them when it comes back ;o)
The 208. range was never in my good books
7:44 pm on Jul 15, 2011 (gmt 0)

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month



Any possible relationship to this activity [webmasterworld.com]?
9:41 pm on Jul 15, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



No, none.
This is Ypages, the other thread is Ybook
9:57 pm on Jul 15, 2011 (gmt 0)

WebmasterWorld Senior Member g1smd is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



There's a LOT of stuff in 208. much of it not good.