homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Google / Google News Archive
Forum Library, Charter, Moderator: open

Google News Archive Forum

Help! Does Google now read JavaScript?!?!
Somehow Google found my adserver

 7:35 pm on Mar 10, 2003 (gmt 0)

I only link to my adserver via JavaScript, and right now Google is killing my site by making loads of requests to it. I've added the following to my robots.txt

User-agent: *
Disallow: /adclick.cgi
Disallow: /adfetch.cgi

Will that stop it?

It also seems to be going through all my cgi files, something it has not done for a while.



 7:37 pm on Mar 10, 2003 (gmt 0)

It sounds like there is a normal HTML link somewhere linking to your ad server. Might also be the toolbar.


 7:44 pm on Mar 10, 2003 (gmt 0)

It is impossible for it to be from a normal HTML link, because JavaScript passes a random number to my cgi adserver script, i.e. /adfetch.cgi?ord=1627156782618&rich=1, and googlebot is going through hundreds of different random numbers. Unless someone has put a HTML page with many static links to my adserver to try and attack me via google?

[edited by: kryton at 7:45 pm (utc) on Mar. 10, 2003]


 7:45 pm on Mar 10, 2003 (gmt 0)

Could it be online stat programs that have referrers from your ad server?


 7:52 pm on Mar 10, 2003 (gmt 0)

that could be it korkus2000. Since I have no control of stats programs at the sites my adserver links to.

Anyway, what I have done with robots.txt should stop it, I hope?

Also could this damage my ranking? Now Google will find thosands of useless pages from my site, or would it just kill the ranking of the adserver page?

I wrote the adserver myself, because I needed ad management on a huge content site I have (probably has over 20,000 pages listed in Google), so the adserver is from the same domain as my content site.

[edited by: kryton at 7:55 pm (utc) on Mar. 10, 2003]


 7:54 pm on Mar 10, 2003 (gmt 0)

I don't think it will hurt your rankings. I would just be concerned about it messing up your tracking. The robots.txt should do the trick.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google News Archive
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved