Should I get excited? So far I've been out of Y!

FAST Enterprise Crawler/6 (www.fastsearch.com) is crawling

[walkman]

is this too part of Y! crawl team or just Slurp? I remember Tim saying that they're adding pages from the Fast crawler too, but Enterprise Crawler? I haven't checked my past logs for this but looks like it's indexing the main links from the front page.

Slurp loves my site, it shows up several times a day but gets just the robots.txt. :). A penalty over the .net, .org pointing to the .com was one thing I came up with. I e-mailed them a few days ago but no answer yet.

Could this be it, or should I wake up and stop dreaming?

On edit: Checked my logs from a week ago. Some 600 files in one day alone. I only have about 2000 or so pages. Let's hope.
Also: This spider is showing only on the site that wasn't already included on Y! serps. Checked the logs fo the other ones, nothing.

[seindal]

I have the same problem with slurp taking only robots.txt, and I have written to Y! about it, but no reply and no change.

I have no reason to believe the site is banned.

René

[walkman]

see if this FAST Enterprise Crawler/6 (www.fastsearch.com) is crawling. You never know.

[seindal]

nope.

[walkman]

don't know what to say, I'm puzzled too. This is the IP 66.151.181.4.

[2_much]

I'm not entirely sure, but I believe Fast Enterprise is an entirely different product that is not even owned by Yahoo. I'll try to find out more about this.

I did hear at a Yahoo presentation that if the spider is only requesting a robots.txt but is not indexing the site, there is a good chance the sites is banned or penalized.

Yahoo may respond to you, but you might want to consider paying for your url to get indexed via Site Match because that will get the site reviewed by an editor.

Part of the idea of Site Match is that you can pay to have customer service so you can have these sorts of problems corrected.

[seindal]

That would be a nice way to make money. Ban random sites to make them pay to be reinstated. If they can't make a positive incentive to pay, make a negative incentive.

I'll wait and see before I pay. The site has been out of their index for many months, and it has done quite well without Y! traffic, so I'm not quite desperate enough yet.

[walkman]

"Part of the idea of Site Match is that you can pay to have customer service so you can have these sorts of problems corrected."

I wish it made economical sense for me to pay $25 a page and than 30 cents a click. It would be $25K to start and then $300 a day for just a click each. I'd need to make $400 profit a day just to pay for Yahoo.

Sadly the Enterprise is separate, just checked it too. Scooter showed up too but I guess Y! didn't share the penalized sites' list yet.

[caveman]

Yahoo may respond to you, but you might want to consider paying for your url to get indexed via Site Match because that will get the site reviewed by an editor.

Part of the idea of Site Match is that you can pay to have customer service so you can have these sorts of problems corrected.

That's a great point that I, for one, had not thought of at all. People have been saying for years that they'd pay for G or any other major SE to review their site when an apparent penalty was in place.

I wonder if it will be possible to indicate upon site submission that part your reason for submitting is to have Y! respond to possibility penalties that might exist, possibly even with some feedback? Now that would be useful, especially to those who really want to practice SEO but stay clearly on the right side of the lines...