crobb305 - 11:43 pm on Mar 3, 2010 (gmt 0)

One of my other issues with the extremely slow crawling is that a site I work with was hit with -40 to -60 in mid Jan (seems to vary day to day, datacenter to datacenter). I have mentioned this in the previous thread so I won't go into details. But, if the filter was imposed algorithmically, then it COULD get lifted algorithmically provided that a deep crawl discovers the on-site changes/cleanup. However, there has been NO deep crawl since January 9th so the changes I have made basically have gone unnoticed. I have no experience with this filter, but I have been hoping for an algorithmic removal. I imagine the filter itself implies a loss of trust which may have affected the crawl rate on this particular site, but I have observed very slow crawling on other sites. Obviously it may take a manual intervention, but I keep hoping and waiting :)

C