Welcome to WebmasterWorld Guest from 54.161.110.184

Forum Moderators: goodroi

Message Too Old, No Replies

Doubt about robots.txt

     
10:07 am on Jan 30, 2011 (gmt 0)

Full Member

5+ Year Member

joined:Jan 14, 2009
posts: 281
votes: 2


I noticed that google indexed
example.com/directory1/?MA
example.com/directory1/?MD
example.com/directory1/?NA
example.com/directory1/?ND

I do not allow parameteres on my /directory1/index.php and probably the fact I did allow directory listing could cause that. The pages are all the same.
I added
Disallow /directory1/?MA
Disallow /directory1/?MD
Disallow /directory1/?NA
Disallow /directory1/?ND

on my robots.txt and by webmaster google tool I removed them succesfully, but
/directory1/ is disapperead too. :(
My website is new.
I believed that Disallow /directory1/?MA do not remove /directory1/ from google. Is that last sentence correct?
5:44 pm on Jan 30, 2011 (gmt 0)

Senior Member

WebmasterWorld Senior Member g1smd is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:July 3, 2002
posts:18903
votes: 0


Yes, it is.

However, it will take a while for Google to add the URLs you do want in place of those that you do not.

If there are NO parameters at all, then this will be simpler code:

Disallow: /*?