Page is a not externally linkable
- Google
-- Google News Archive
---- Help! Does Google now read JavaScript?!?!


kryton - 7:35 pm on Mar 10, 2003 (gmt 0)


I only link to my adserver via JavaScript, and right now Google is killing my site by making loads of requests to it. I've added the following to my robots.txt

User-agent: *
Disallow: /adclick.cgi
Disallow: /adfetch.cgi

Will that stop it?

It also seems to be going through all my cgi files, something it has not done for a while.


Thread source:: http://www.webmasterworld.com/google_archive/10288.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com