Welcome to WebmasterWorld Guest from 22.214.171.124
Forum Moderators: martinibuster
We think we have the same problem in one of our sites. It was banned. We fixed it up to eliminate anything that might be considered abuse such as www.foo.com and foo.com delivering the same content and applied to be unbanned. Slurp came back and eventually we started to see more pages indexed. But now slurp only accesses robots.txt (50 times a day) and we are down to six pages in the index so it looks like we are "re-banned". We are totally mystified as to what could be causing the problem.