Msg#: 20889 posted 4:40 pm on Dec 31, 2003 (gmt 0)
Further to the above when I go to a well known search engine that uses results from the search engine that appears to be creating these unusual redirected URLs, I find that this exact form of the URL is used and that the SE site does not have a robots.txt file. You just get a 404 error page.
I guess that someone must have a canned find on their page somewhere into this particular search engine. My site is #1 and Googlebot has found his way along the redirect to my site.
This is happenning but is it going to cause Google to penalise my site in any way. It looks to Google like two URLs duplicate content.
I tracked down where these URLs were comming from. A black dog search engine didn't have a robots.txt file in its root and googlebot was able to spider search results. Not sure where it found the link to get into the results though.
I wrote to the webmaster at the search engine and he/she has now put in a robots.txt file so hopefully these dodgy URLs will stop now.