Keeping out freshbot

How do I stop this?

[Brian]

I have a problem with freshbot causing my index page mydomain.com to be dropped. I have raised this issue here before, to no avail. In short, when freshbot comes around, the page (which is #1 on the monthly index) disappears unless the Google search button is hit a second time (and no this is not at my end - happens on www. www2. www3, Yahoogle, IE, Netscape, other people's systems). Nobody seems to know why.

I figure my only option is to bar the freshbot from my index page. Does anyone know how to do this - without barring it from the whole site? And is there any optimum time to do it?

Any help would be appreciated.

[Jesse_Smith]

See if banning 64.68.82.* works.

[Stefan]

Brian, I remember the earlier posts. There has to be a problem that can be solved without resorting to banning the freshbot. You really don't want to do that. It's a very bizarre problem but let this thread run for a while and see if it helps before you do something so drastic as banning your best friend.

Good luck

[steveb]

If your site was in your profile help might be easier to come by. As it is, what you describe just sounds weird.

[joeuz]

Actually, I noticed the same thing. When Freshbot visits one of my sites, it drops down 2 positions in the results for an important keyword. A few days later, it is back to its original place again. One thing I noticed is that it gets a cached date in the results when this happens. When it goes back to the original position, the cached date disappears.

[Brian]

Joe: Have you tried clicking the Google search button a second time? When I do this, I get a different result, with the fresh page reappearing in its regular #1 monthly position for the keywords. I'd be interested to know if anything similar happens to you.

I don't see how you can interrogate Google twice and get different results, but that is what happens to me when my index is freshed (and no folks, this is NOT at my end).