homepage Welcome to WebmasterWorld Guest from 23.22.128.96
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
Is this valid?
aha7




msg:3334374
 12:39 am on May 9, 2007 (gmt 0)

Hello,

Can I use the following to define googlebot?

User-agent: google

Will Googlebot (and other user agents that start with the string "google") follow the instructions following that line? Is it case sensetive or not?

 

daveozzz




msg:3334649
 8:20 am on May 9, 2007 (gmt 0)

This doesn't answer your question entirely but to be safe perhaps follow the instructions on Google Blog [google.com]

goodroi




msg:3334785
 12:34 pm on May 9, 2007 (gmt 0)

It is not valid. It might work, it might not but it is not valid. If you want to be sure Google will do what you want you need to follow Google's instructions.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved