Welcome to WebmasterWorld Guest from 188.8.131.52 , register , free tools , login , search , pro membership , help , library , announcements , recent posts , open posts Pubcon Platinum Sponsor 2014
Disallow: /adclick.cgi Disallow: /adfetch.cgi
Will that stop it?
It also seems to be going through all my cgi files, something it has not done for a while.
It sounds like there is a normal HTML link somewhere linking to your ad server. Might also be the toolbar. kryton
Could it be online stat programs that have referrers from your ad server? kryton
that could be it korkus2000. Since I have no control of stats programs at the sites my adserver links to.
Anyway, what I have done with robots.txt should stop it, I hope?
Also could this damage my ranking? Now Google will find thosands of useless pages from my site, or would it just kill the ranking of the adserver page?
I wrote the adserver myself, because I needed ad management on a huge content site I have (probably has over 20,000 pages listed in Google), so the adserver is from the same domain as my content site.
[ edited by: kryton at 7:55 pm (utc) on Mar. 10, 2003] korkus2000
I don't think it will hurt your rankings. I would just be concerned about it messing up your tracking. The robots.txt should do the trick.