Page is a not externally linkable
soapystar - 9:24 pm on Sep 21, 2005 (gmt 0)
agreed. Except for anyone trying to come out of a ban theres no apparent threshold, you just cant have one. So if the point of this thread is about unbanning then you simply cant 'get' links if you think the eyes on you. yes its normal for them to crawl, but not agressively. The giveaway is normally the robots to actual pages ratio of crawling.
As far as ye olde basic recip campaign, that still seems to work. What I am wondering is, is it normal for slurp to keep crawling the site aggressively even though they have a manual ban on the site?