Welcome to WebmasterWorld Guest from 54.145.174.178

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

Reasons for using Googlebot user agent?

   
7:29 pm on Mar 18, 2010 (gmt 0)

5+ Year Member



What are the reasons for wanting to occasionally switching to the Googlebot user agent? I know people do it to check for cloaking, but are there other reasons? Just curious to hear how people use it...

[edited by: incrediBILL at 8:48 pm (utc) on Mar 18, 2010]
[edit reason] fixed typo [/edit]

8:53 pm on Mar 18, 2010 (gmt 0)

WebmasterWorld Administrator incredibill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



Snooping people do this to see how Google sees your website, mostly for SEO purposes.

Some sites only send text to Google, no formatting.

Some sites load their text with extra keywords for Google to see.

However, smart sites like mine validate Googlebot and will boot you to the curb for faking so you'll never see what I'm showing Google, never, ever.
1:12 am on Mar 19, 2010 (gmt 0)

WebmasterWorld Senior Member keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



However, smart sites like mine validate Googlebot and will boot you to the curb for faking so you'll never see what I'm showing Google, never, ever.

+1
2:30 am on Mar 19, 2010 (gmt 0)

10+ Year Member



At least one site (and we probably all know which one I'm talking about) shows Googlebot answers to questions, but only shows the questions to real people, along with a link to sign up for a paid subscription. Unless you tell your browser to send a Googlebot UA; then you get the answers too. That site does not validate Googlebot.
9:25 am on Mar 20, 2010 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Scrapers use this in an attempt to bypass controls. Some sites will whitelist the large search engine bots but apply access controls and limits to ordinary browsers.

Regards...jmcc