Forum Moderators: open

Message Too Old, No Replies

googlebot's communication policy

everything you wanted to ask googlebot

         

amazed

3:35 pm on Jun 8, 2003 (gmt 0)

10+ Year Member



she tells you

[google.com...]

just noticed this in my logfiles. I am probably the last one here to notice, but just in case.....

DerekH

10:29 pm on Jun 8, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Actually, having read the Google page and followed its links, I was smiling when I came across...

---
<META name="ROBOTS" content="NOINDEX, NOFOLLOW">

The list of terms in the content is ALL, INDEX, NOFOLLOW, NOINDEX.
---
All those people saying "put in a <INDEX, FOLLOW>" - it helps - really have been wasting their time - FOLLOW isn't a prescribed word...

Good job I left it out... <wink>
DerekH

mozopera

1:35 am on Jun 9, 2003 (gmt 0)

10+ Year Member



You may not have read far enough:
[robotstxt.org...]

FOLLOW if I remember correctly, used to be recommended for one of the search engine's spiders, otherwise it does not follow the links on the page. (Was it Hotbot? Inktomi?)

jdMorgan

1:55 am on Jun 9, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



It was Ink.

Jim