Welcome to WebmasterWorld Guest from 54.162.93.137

Forum Moderators: goodroi

Message Too Old, No Replies

Doubt about robots.txt

     
10:07 am on Jan 30, 2011 (gmt 0)

5+ Year Member



I noticed that google indexed
example.com/directory1/?MA
example.com/directory1/?MD
example.com/directory1/?NA
example.com/directory1/?ND

I do not allow parameteres on my /directory1/index.php and probably the fact I did allow directory listing could cause that. The pages are all the same.
I added
Disallow /directory1/?MA
Disallow /directory1/?MD
Disallow /directory1/?NA
Disallow /directory1/?ND

on my robots.txt and by webmaster google tool I removed them succesfully, but
/directory1/ is disapperead too. :(
My website is new.
I believed that Disallow /directory1/?MA do not remove /directory1/ from google. Is that last sentence correct?
5:44 pm on Jan 30, 2011 (gmt 0)

WebmasterWorld Senior Member g1smd is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



Yes, it is.

However, it will take a while for Google to add the URLs you do want in place of those that you do not.

If there are NO parameters at all, then this will be simpler code:

Disallow: /*?
 

Featured Threads

Hot Threads This Week

Hot Threads This Month