Help! Does Google now read JavaScript?!?!

Somehow Google found my adserver

[kryton]

I only link to my adserver via JavaScript, and right now Google is killing my site by making loads of requests to it. I've added the following to my robots.txt

User-agent: *
Disallow: /adclick.cgi
Disallow: /adfetch.cgi

Will that stop it?

It also seems to be going through all my cgi files, something it has not done for a while.

[korkus2000]

It sounds like there is a normal HTML link somewhere linking to your ad server. Might also be the toolbar.

[kryton]

It is impossible for it to be from a normal HTML link, because JavaScript passes a random number to my cgi adserver script, i.e. /adfetch.cgi?ord=1627156782618&rich=1, and googlebot is going through hundreds of different random numbers. Unless someone has put a HTML page with many static links to my adserver to try and attack me via google?

[edited by: kryton at 7:45 pm (utc) on Mar. 10, 2003]

[korkus2000]

Could it be online stat programs that have referrers from your ad server?

[kryton]

that could be it korkus2000. Since I have no control of stats programs at the sites my adserver links to.

Anyway, what I have done with robots.txt should stop it, I hope?

Also could this damage my ranking? Now Google will find thosands of useless pages from my site, or would it just kill the ranking of the adserver page?

I wrote the adserver myself, because I needed ad management on a huge content site I have (probably has over 20,000 pages listed in Google), so the adserver is from the same domain as my content site.

[edited by: kryton at 7:55 pm (utc) on Mar. 10, 2003]

[korkus2000]

I don't think it will hurt your rankings. I would just be concerned about it messing up your tracking. The robots.txt should do the trick.