Forum Moderators: phranque
The reason was my banner rotation system making links with parameters.
The banners had been inserted with SSI, so they had been direct in the html. All links from the banners had parameter strings.
I wrote to the webmaster of the unknown search engine, they promised not to spider me again....
....June 2000, panic! Default search engine from Yahoo is now Google, the unknown search engine banned from my main site.
So I wrote them to spider me again.
Late 2000, I abandoned the banner rotation system.
Now we have 2006 and Googlebot spiders still this?parameter URLs
Since this domain is since June 27 in a search filter from Google, I try now to identify and eliminate any possible problem.
Last month, I made this www to non www redirects.
Now is the next question, how to redirect from
folder-name/file-name.htm?here-goes-a-parameter-string
to
folder-name/file-name.htm
folder-name/file-name.htm?here-goes-a-parameter-string
to
folder-name/file-name.htm
# If non-blank query string
RewriteCond %{QUERY_STRING} .
# remove it from specific folder/file
RewriteRule ^folder-name/file-name\.htm$ http://www.example.com/folder-name/file-name.ht[b]m?[/b] [R=301,L]