Welcome to WebmasterWorld Guest from 54.167.83.224

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

Yellow Pages bot impersonating Googlebot?

     
12:16 am on Apr 20, 2011 (gmt 0)

Junior Member

5+ Year Member

joined:Jan 25, 2011
posts:51
votes: 0


I just saw this on my log:

64.209.132.4 - - [19/Apr/2011:04:37:59 -0400] "GET /filename.html HTTP/1.1" 403 380 "-" "YPBot/Raven1.1.3 (compatible; Googlebot/2.1;+http://www.yellowpages.com/about/legal/crawl)"

Yellow Pages IP with both their bot and Googlebot names...?

Do the yellow pages and google have a partnership?

What is going on...should I allow them access?

Any advice would be appreciated.
7:00 am on Apr 20, 2011 (gmt 0)

Senior Member

WebmasterWorld Senior Member topr8 is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Apr 19, 2002
posts:3171
votes: 8


anything calling itself googlebot that doesn't pass a reverse dns test gets blocked by us.
1:08 am on Apr 21, 2011 (gmt 0)

Junior Member

5+ Year Member

joined:Jan 25, 2011
posts:51
votes: 0


I blocked them, but thought it was very odd that a relatively mainstream company would attempt to pull a fast one.
9:41 am on Apr 25, 2011 (gmt 0)

Senior Member

WebmasterWorld Senior Member topr8 is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Apr 19, 2002
posts:3171
votes: 8


... actually there is no hostname associated with the ip address you gave ...

quite possibly not yellow pages either!
10:52 am on Apr 25, 2011 (gmt 0)

Administrator

WebmasterWorld Administrator phranque is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Aug 10, 2004
posts:10544
votes: 8


Yellowpages.com SAVV-S265785-1 (NET-64-209-132-0-1) 64.209.132.0 - 64.209.132.255
1:14 pm on Apr 25, 2011 (gmt 0)

Senior Member

WebmasterWorld Senior Member topr8 is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Apr 19, 2002
posts:3171
votes: 8


ok so it is yellow pages, but no hostname set up!
7:14 pm on Apr 25, 2011 (gmt 0)

Senior Member from GB 

WebmasterWorld Senior Member dstiles is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:May 14, 2008
posts:3092
votes: 2


I have no bot recorded as having come from that range and certainly not a googlebot, which would get rejected on that IP range, or a YP bot.

There is no rDNS, as topr8 mentions, so it's due a blocking.

The parent of that IP range is Savvis, which is worth blocking anyway.
6:11 pm on July 15, 2011 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:May 24, 2002
posts:894
votes: 0


Got a visit today from 208.93.105.250 - null.ev1.yellowpages.com
YPBot/Raven1.1.3 (compatible; Googlebot/2.1; http: //www.yellowpages.com/about/legal/crawl)

Took robots.txt and left, well good luck to them when it comes back ;o)
The 208. range was never in my good books
7:44 pm on July 15, 2011 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month

joined:Apr 9, 2011
posts:12721
votes: 244


Any possible relationship to this activity [webmasterworld.com]?
9:41 pm on July 15, 2011 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:May 24, 2002
posts:894
votes: 0


No, none.
This is Ypages, the other thread is Ybook
9:57 pm on July 15, 2011 (gmt 0)

Senior Member

WebmasterWorld Senior Member g1smd is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:July 3, 2002
posts:18903
votes: 0


There's a LOT of stuff in 208. much of it not good.