Totally Frustrated!

Can't get robots.txt to work...

[menyak]

Ok, as everybody knows, the Google dance is on. For the second time in a row I couldn't get my robots.txt file working. This is frustrating - I would really appreciate some help...

Here's what I did:
- I placed a "robots.txt" file on my site (same location where www.mysite.com/index.php is located).
- Here's what's inside (among others)

User-agent: *
Disallow: /forums/profile.php
Disallow: /forums/search.php

Yet, Google spidered all the files like...

www.mysite.com/profile.php?mode=viewprofile&u=25
or
www.mysite.com/forums/search.php?search_id=unanswered

<sobb> What on earth am I doing wrong?!

[pendanticist]

Does it look like this www.mysite.com/robots.txt?

Or, do you have it tagged in some other fashion?

Pendanticist.

[Chico_Loco]

Did you create this file before or after google crawled your site?

[Terrier]

Have you checked it with the robots text validator on searchengineworld.

[menyak]

Oh, wow! I invented the "Allow" tag although this doesn't even exist. (Don't know where I got that from?) If one line is invalid, the whole file will be ignored?

[menyak]

Hm, I think I "borrowed" this from the protocol for the .htaccess file...

Another question, just to make sure:
#Disallow: /blabla
...(hopefully) will mean that this line is commented out and wont be read and/or cause an error?

[menyak]

Ok even if none of you guys will read this anymore because it was moved to a different forum - thanks everybody for the input and special thanks to Terrier who (hopefully :) led the way to solving this.

[Terrier]

Glad to hear you are getting it sorted. It's from mistakes that one learns, Tell me about it. LOL