Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

robots.txt question



5:25 pm on Jul 15, 2004 (gmt 0)

10+ Year Member

I hope this isn't a dumb question... It's really a curiousity thing so don't ask why I'm asking, I'm just trying to learn. :)

I have a php website. My "header" is in a separate file so I use an includes statement on all my regular pages. If I put header.php in the robots.txt file, will that either 1 - cause an error to the robots or 2 - disallow the header on all my regular pages?

Thanks so much for any help!


4:37 am on Jul 17, 2004 (gmt 0)

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member


Welcome to WebmasterWorld [webmasterworld.com]!

The inclusion of that header is done at a different level; for practical purposes, the header is part of the page, and is not requested separately (by a browser or by a robot). For that reason, disallowing it in robots.txt won't have any effect.



5:30 pm on Jul 17, 2004 (gmt 0)

10+ Year Member

Thanks for the response Jim! Exactly what I was looking for. This forum is awesome for newbies like me. Thanks again!

Featured Threads

Hot Threads This Week

Hot Threads This Month