Samizdata
msg:3602337 | 9:10 pm on Mar 16, 2008 (gmt 0) |
Assuming you are on an Apache server, have a look at the posts in the WebmasterWorld Apache Web Server forum on how to deal with unwanted query strings using mod_rewrite (if on Windows try that forum). There is nothing you can do about this with a robots.txt file. The 304 response means that the content has not changed since last requested. [edited by: Samizdata at 9:10 pm (utc) on Mar. 16, 2008]
|
Reilly
msg:3602695 | 8:25 am on Mar 17, 2008 (gmt 0) |
i need to prevent Google to spider that query file.html is not the same like file.html?ref=example.com i do not have mod_rewrite :( - please how is the syntax to prevent Googlebot from spidering that fake query? i need disallow: ref= or what ? i do not use querys with ?ref= - so it must be easy to disallow Googlebot to spider that file with this query?
|
Reilly
msg:3603253 | 7:55 pm on Mar 17, 2008 (gmt 0) |
i have found this Disallow: /*ref=* does this disallow Google to spider that ? [edited by: Reilly at 7:56 pm (utc) on Mar. 17, 2008]
|
|
