Forum Moderators: DixonJones

Message Too Old, No Replies

A file I don't want ANY bots to follow.

<META NAME="ROBOTS" CONTENT="noindex, nofollow">?

         

pendanticist

4:51 am on Apr 14, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



<META NAME="ROBOTS" CONTENT="noindex, nofollow">

A particular temporary file I want to put up must not be followed or indexed.

Is this the wrong tag? Because it sure doesn't seem to work for Google.

Pendanticist.

MarieC

5:10 am on Apr 14, 2003 (gmt 0)

10+ Year Member



The only thing I can think to change would be to make the whole thing lower case or upper case.

[robotstxt.org...]

pendanticist

5:29 am on Apr 14, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



The only thing I can think to change would be to make the whole thing lower case or upper case.

While the link you provided indicates all words cased the same, it also states:

"Note: Currently only few robots support this tag!"

Well, <chuckle> that wasn't what I wanted to see! :)

Sooooo, clicking thru to The Robots META tag [robotstxt.org] section where it does support your statement to case by example.

For the life of me, I don't know how that slipped by me. Then again, it's like my Grandfather used to say: "If you don't learn something new every day, you're just not listening."

Thanks MarieC

Pendanticist.

MarieC

5:48 am on Apr 14, 2003 (gmt 0)

10+ Year Member



Another possibility would be to put the temporary file in a separate subdirectory and make that subdirectory disallowed in your robots.txt file. Or maybe that's not feasible.

Love what your grandfather said. If it's okay, I'm going to use that.

pendanticist

6:04 am on Apr 14, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Certainly :)

Pendanticist.