Why bother crawling?

[webzilla]

I have several sites that are semi banned (index page indexed, not others, not ranking for anything except searches for the domain name itelf) by Yahoo. No complaints; I'm over that and I live with it. But.....

Why does Yahoo have to keep deep-crawling these sites day after day, month after month, year after year? This does not make any sense.

[heisje]

.

same here.
seems a meaningless waste of bandwidth.
what is the point? any ideas?

heisje

.

[steveb]

If you ban something, you do it for a reason.

If you continue to ban something, you have to see if the reason is still there.

[randle]

If you continue to ban something, you have to see if the reason is still there.

But they take no action; lots of sites that are penalized fix the problem and don't get back in, even after filing re-inclusion requests. They don’t go looking to re-include sites as a habit in my experience. So I think the question about why they bother with the crawling is a valid one.

I don't think they have a real good handle on the penalty system they have in place, least of all the incurrence of the penalty in the first place, and subsequent responses to re-inclusion requests. Perhaps they are working on the problem though, as lately I have seen some results displayed with penalized sites.

[walkman]

>> If you continue to ban something, you have to see if the reason is still there.

Not the case with Y!. Site has changed 400% :) yet still not in Yahoo