homepage Welcome to WebmasterWorld Guest from 23.20.196.179
register, login, search, subscribe, help, library, PubCon, announcements, recent posts, open posts,
Subscribe and Support WebmasterWorld
Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library : Charter : Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
Doubt about robots.txt
serenoo




msg:4260121
 10:07 am on Jan 30, 2011 (gmt 0)

I noticed that google indexed
example.com/directory1/?MA
example.com/directory1/?MD
example.com/directory1/?NA
example.com/directory1/?ND

I do not allow parameteres on my /directory1/index.php and probably the fact I did allow directory listing could cause that. The pages are all the same.
I added
Disallow /directory1/?MA
Disallow /directory1/?MD
Disallow /directory1/?NA
Disallow /directory1/?ND

on my robots.txt and by webmaster google tool I removed them succesfully, but
/directory1/ is disapperead too. :(
My website is new.
I believed that Disallow /directory1/?MA do not remove /directory1/ from google. Is that last sentence correct?

 

g1smd




msg:4260205
 5:44 pm on Jan 30, 2011 (gmt 0)

Yes, it is.

However, it will take a while for Google to add the URLs you do want in place of those that you do not.

If there are NO parameters at all, then this will be simpler code:

Disallow: /*?
Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
WebmasterWorld ® and PubCon ® are a Registered Trademarks of Pubcon Inc.
© Pubcon Inc. 1996-2012 all rights reserved