Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Doubt about robots.txt

10:07 am on Jan 30, 2011 (gmt 0)

Full Member

10+ Year Member

joined:Jan 14, 2009
posts: 281
votes: 2

I noticed that google indexed

I do not allow parameteres on my /directory1/index.php and probably the fact I did allow directory listing could cause that. The pages are all the same.
I added
Disallow /directory1/?MA
Disallow /directory1/?MD
Disallow /directory1/?NA
Disallow /directory1/?ND

on my robots.txt and by webmaster google tool I removed them succesfully, but
/directory1/ is disapperead too. :(
My website is new.
I believed that Disallow /directory1/?MA do not remove /directory1/ from google. Is that last sentence correct?
5:44 pm on Jan 30, 2011 (gmt 0)

Senior Member

WebmasterWorld Senior Member g1smd is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:July 3, 2002
votes: 0

Yes, it is.

However, it will take a while for Google to add the URLs you do want in place of those that you do not.

If there are NO parameters at all, then this will be simpler code:

Disallow: /*?

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members