Yahoo! crawlers going nuts on my site

25th day of every month

[millie]

On the 25th day of every month Yahoo! crawlers access my site around 1800 times, making around 5 - 6 page views each time.

It makes a nonsense of my stats analysis. Is there anything I can do about this? Why so consistently the 25th day of the month?

[hermosa]

Count yourself lucky. I haven't seen them even once at my site yet they do have in their cache's pictures of my site that reflect changes that were madea a month ago. I have never seen Mozilla! Slurp! turn up in my logs. Am I missing something?

[millie]

Sadly it doesn't help my search engine positioning at all, but yes I guess I should be really grateful I get visited at all :-)

[Larryhat]

Hello Millie:

Like you, I'm glad to get spidered, regardless of the results. I get hit pretty thoroughly by the 3 major SEs weekly, if not daily. This makes me feel better, as though I'm at least under some consideration. If I finally make the right improvements to my pages, then maybe the all-seeing Google will smile on my SERPS, and give them a boost. If the G would toss out a few long dead pages, even that would be a boost.

I have to question their algorithms however.

How long does it take for man or machine to figure out that a site that died 3+ years ago, domain snatched by pirates in Hong Kong, even cached versions totally blank for years, is no longer relevant?

Yet there it is, and no doubt others like it, forever shoving honest living sites and pages down by a knotch or 3 in the results.

Oh heck, forgive me my little rant. How do you optimize for Gigablast anyhow? - Larry