Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

robots.txt and htaccess

.htaccess circumvents to site root

3:47 pm on Jan 24, 2004 (gmt 0)

New User

10+ Year Member

joined:Nov 26, 2003
votes: 0


I currently am using htaccess to cause a jump into a part of my site that is excluded from search robots etc.

This means the root: www.my_url.com/index.htm is redundant for the purposes of the search bot because the htaccess file grabs it first.

The trouble is I ONLY want the www.my_url.com/index.htm indexed.

Any help would be much appreciated.
I found this forum by accident last year, it is one of the better ones, thanks.

I have implemented the "perfect .htaccess banlist recently, still testing it.." [webmasterworld.com...]

Kind regards, Steve

[edited by: stefan009 at 5:36 pm (utc) on Jan. 24, 2004]

4:02 pm on Jan 24, 2004 (gmt 0)

Junior Member

10+ Year Member

joined:Jan 27, 2003
votes: 0

Wouldn't your purpose also served by not redirecting the home page (and the other pages) but just storing everything except the home page in a subdirectory (say /pages/) and disallowing this subdirectory to robots in the robots.txt?
4:06 pm on Jan 24, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Apr 27, 2002
votes: 0

First off, Welcome to WebmasterWorld [webmasterworld.com], stefan009 :)

Suggested Reading: TOS [webmasterworld.com], especially # 13.

You may still have time to edit your post. ;)

5:35 pm on Jan 24, 2004 (gmt 0)

New User

10+ Year Member

joined:Nov 26, 2003
votes: 0

Hello pendanticist,

sorry about that, I'd be happy if the post was deleted.

the re-direction... is dynamic using an error 404 trap, so it can go anywhere depending on the suffix at the end og the url so your_url/abc goes one place and your_url/xyz goes someplace else.

If the index.htm in the site root is bypassed because of what I have in my .htaccess there probably isn't much I can do without changing the set-up, unless the robot was to ask for your_url/index.htm instead of your_url period.

the htaccess will leave alone any request with a file specified.

regards, Steve.


Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members