Forum Moderators: open

Message Too Old, No Replies

Google News Spider Agent

         

engine

4:25 pm on Dec 2, 2009 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Google's new user agent called Googlebot-News

Google News Spider Agent [googlewebmastercentral.blogspot.com]

Now, publishers can manage their content in Google News in an even more automated way. Site owners can just add Googlebot-News specific directives to their robots.txt file. Similar to the Googlebot and Googlebot-Image user agents, the new Googlebot-News user agent can be used to specify which pages of a website should be crawled and ultimately appear in Google News.

We are currently testing our support for the new user agent.

GaryK

2:16 pm on Dec 3, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I wonder what News Corp's objections to Google News will be now?