Welcome to WebmasterWorld Guest from 54.161.201.200

Forum Moderators: open

Message Too Old, No Replies

Help! Does Google now read JavaScript?!?!

Somehow Google found my adserver

     
7:35 pm on Mar 10, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Oct 25, 2002
posts:46
votes: 0


I only link to my adserver via JavaScript, and right now Google is killing my site by making loads of requests to it. I've added the following to my robots.txt

User-agent: *
Disallow: /adclick.cgi
Disallow: /adfetch.cgi

Will that stop it?

It also seems to be going through all my cgi files, something it has not done for a while.

7:37 pm on Mar 10, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member korkus2000 is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Mar 20, 2002
posts:3732
votes: 0


It sounds like there is a normal HTML link somewhere linking to your ad server. Might also be the toolbar.
7:44 pm on Mar 10, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Oct 25, 2002
posts:46
votes: 0


It is impossible for it to be from a normal HTML link, because JavaScript passes a random number to my cgi adserver script, i.e. /adfetch.cgi?ord=1627156782618&rich=1, and googlebot is going through hundreds of different random numbers. Unless someone has put a HTML page with many static links to my adserver to try and attack me via google?

[edited by: kryton at 7:45 pm (utc) on Mar. 10, 2003]

7:45 pm on Mar 10, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member korkus2000 is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Mar 20, 2002
posts:3732
votes: 0


Could it be online stat programs that have referrers from your ad server?
7:52 pm on Mar 10, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Oct 25, 2002
posts:46
votes: 0


that could be it korkus2000. Since I have no control of stats programs at the sites my adserver links to.

Anyway, what I have done with robots.txt should stop it, I hope?

Also could this damage my ranking? Now Google will find thosands of useless pages from my site, or would it just kill the ranking of the adserver page?

I wrote the adserver myself, because I needed ad management on a huge content site I have (probably has over 20,000 pages listed in Google), so the adserver is from the same domain as my content site.

[edited by: kryton at 7:55 pm (utc) on Mar. 10, 2003]

7:54 pm on Mar 10, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member korkus2000 is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Mar 20, 2002
posts:3732
votes: 0


I don't think it will hurt your rankings. I would just be concerned about it messing up your tracking. The robots.txt should do the trick.
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members