Forum Moderators: open

Message Too Old, No Replies

googlebot confused?

what to do googlebot crawls lots of non existing cgi pars

         

eraldemukian

2:36 am on Apr 17, 2004 (gmt 0)

10+ Year Member



A couple of days ago, googlebot started to crawl pages like:

www.widget.com/?ss3=maps&ff3=randomcharactershere&text=email

In last 4 hours it liked to see 619 of those, but only 21 real
pages of my site. Those parameters do NOT originate from my site.

Does anybody have any advice, how to correct this?

I can not generate a 404, since these are CGI parameters gone wrong.
I am not sure if anybody created a huge amount of links to my site,
of this is a corruption in the data that the bot read from.

I am just worried, that googles view of my site will be very skewed: all those parameters basically point to the same page. One that my CGI generates when it does not understand the parameters. I would rather have google crawl my real content, then to duplicate the same thousand times.

ThomasB

9:58 pm on Apr 18, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Is it possible that anybody linked to these pages (referers)? Is it an expired domain?