Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Question about robots meta tag, as well as robots.txt....



11:49 pm on May 19, 2004 (gmt 0)

10+ Year Member

Hello guys, i think i have the robots.txt setup right... but i basically dont want the robots to index ANYTHING in the /images/ folder...
sooo i have:

User-agent: *
Disallow: /images

i believe that will stop them from indexing anything inside of the /images directory? also, could i simply put: Disallow: /images /adminstuff to have it block both directorys?

as for the robots meta tag...

i have a header.php, and obviously all of my index.php files call it, now... would it be redundant or would it cause any harm to have:

<META name="ROBOTS" content="INDEX, FOLLOW">

being that every time it hits a index.php, it would index that, as well as follow to index2.php, which it would them index and follow back to index.php being every page I have also has a link back to the main index.php?

if it sounds confusing let me know and ill try and explain it better.

i thank you for your time.


11:22 am on May 20, 2004 (gmt 0)

10+ Year Member



11:48 am on May 20, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

Personally I'd use the following, just to ensure that only the directory was being disallowed (trailing slash). If you want to add a second disallowed item then create yourself a second entry;

User-agent: *
Disallow: /images/
Disallow: /adminstuff/

As for the meta tag, I'd consider "index, follow" as redundant because that's the default behaviour so you could say nothing and achieve the same effect - but if you want to keep it there feel free because the only harm it will do is add an extra line to your source code.

- Tony


Featured Threads

Hot Threads This Week

Hot Threads This Month