Welcome to WebmasterWorld Guest from 220.127.116.11 , register , free tools , login , search , subscribe , help , library , announcements , recent posts , open posts Subscribe and Support WebmasterWorld
Disallow: /adclick.cgi Disallow: /adfetch.cgi
Will that stop it?
It also seems to be going through all my cgi files, something it has not done for a while.
korkus2000 msg:36481 7:37 pm on Mar 10, 2003 (gmt 0)
It sounds like there is a normal HTML link somewhere linking to your ad server. Might also be the toolbar. kryton msg:36482 7:44 pm on Mar 10, 2003 (gmt 0)
Could it be online stat programs that have referrers from your ad server? kryton msg:36484 7:52 pm on Mar 10, 2003 (gmt 0)
that could be it korkus2000. Since I have no control of stats programs at the sites my adserver links to.
Anyway, what I have done with robots.txt should stop it, I hope?
Also could this damage my ranking? Now Google will find thosands of useless pages from my site, or would it just kill the ranking of the adserver page?
I wrote the adserver myself, because I needed ad management on a huge content site I have (probably has over 20,000 pages listed in Google), so the adserver is from the same domain as my content site.
[ edited by: kryton at 7:55 pm (utc) on Mar. 10, 2003] korkus2000 msg:36485 7:54 pm on Mar 10, 2003 (gmt 0)
I don't think it will hurt your rankings. I would just be concerned about it messing up your tracking. The robots.txt should do the trick.