Welcome to WebmasterWorld Guest from 23.20.37.222

Forum Moderators: open

Message Too Old, No Replies

Help! Does Google now read JavaScript?!?!

Somehow Google found my adserver

     
7:35 pm on Mar 10, 2003 (gmt 0)

10+ Year Member



I only link to my adserver via JavaScript, and right now Google is killing my site by making loads of requests to it. I've added the following to my robots.txt

User-agent: *
Disallow: /adclick.cgi
Disallow: /adfetch.cgi

Will that stop it?

It also seems to be going through all my cgi files, something it has not done for a while.

7:37 pm on Mar 10, 2003 (gmt 0)

WebmasterWorld Senior Member korkus2000 is a WebmasterWorld Top Contributor of All Time 10+ Year Member



It sounds like there is a normal HTML link somewhere linking to your ad server. Might also be the toolbar.
7:44 pm on Mar 10, 2003 (gmt 0)

10+ Year Member



It is impossible for it to be from a normal HTML link, because JavaScript passes a random number to my cgi adserver script, i.e. /adfetch.cgi?ord=1627156782618&rich=1, and googlebot is going through hundreds of different random numbers. Unless someone has put a HTML page with many static links to my adserver to try and attack me via google?

[edited by: kryton at 7:45 pm (utc) on Mar. 10, 2003]

7:45 pm on Mar 10, 2003 (gmt 0)

WebmasterWorld Senior Member korkus2000 is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Could it be online stat programs that have referrers from your ad server?
7:52 pm on Mar 10, 2003 (gmt 0)

10+ Year Member



that could be it korkus2000. Since I have no control of stats programs at the sites my adserver links to.

Anyway, what I have done with robots.txt should stop it, I hope?

Also could this damage my ranking? Now Google will find thosands of useless pages from my site, or would it just kill the ranking of the adserver page?

I wrote the adserver myself, because I needed ad management on a huge content site I have (probably has over 20,000 pages listed in Google), so the adserver is from the same domain as my content site.

[edited by: kryton at 7:55 pm (utc) on Mar. 10, 2003]

7:54 pm on Mar 10, 2003 (gmt 0)

WebmasterWorld Senior Member korkus2000 is a WebmasterWorld Top Contributor of All Time 10+ Year Member



I don't think it will hurt your rankings. I would just be concerned about it messing up your tracking. The robots.txt should do the trick.
 

Featured Threads

Hot Threads This Week

Hot Threads This Month