homepage Welcome to WebmasterWorld Guest from 54.225.24.227
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
he is back look UE - Mediapartners-Google/2.1
he is back look UE - Mediapartners-Google/2.1
StopSpam




msg:405935
 10:47 am on Jul 22, 2003 (gmt 0)

Date/time: Tue - Jul - 8 - 14:58:10 2003

UE: Mediapartners-Google/2.1 (+http://www.googlebot.com/bot.html)

IP: 64.68.87.41
Host : crawler8.googlebot.com

Requested file: www.somesite.com/robots.txt

Spoofing UE is easy but also the google ip/host?
i think it is a real bot google spidering some sites for some special google clients.

right?

 

jeremy goodrich




msg:405936
 10:22 pm on Jul 22, 2003 (gmt 0)

It's for the adwords / adsense programs ;)

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved