Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Doubt about robots.txt



10:07 am on Jan 30, 2011 (gmt 0)

5+ Year Member

I noticed that google indexed

I do not allow parameteres on my /directory1/index.php and probably the fact I did allow directory listing could cause that. The pages are all the same.
I added
Disallow /directory1/?MA
Disallow /directory1/?MD
Disallow /directory1/?NA
Disallow /directory1/?ND

on my robots.txt and by webmaster google tool I removed them succesfully, but
/directory1/ is disapperead too. :(
My website is new.
I believed that Disallow /directory1/?MA do not remove /directory1/ from google. Is that last sentence correct?


5:44 pm on Jan 30, 2011 (gmt 0)

WebmasterWorld Senior Member g1smd is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

Yes, it is.

However, it will take a while for Google to add the URLs you do want in place of those that you do not.

If there are NO parameters at all, then this will be simpler code:

Disallow: /*?

Featured Threads

Hot Threads This Week

Hot Threads This Month