homepage Welcome to WebmasterWorld Guest from 54.145.172.149
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Yahoo / Yahoo Search Engine and Directory
Forum Library, Charter, Moderators: martinibuster

Yahoo Search Engine and Directory Forum

    
Should I get excited? So far I've been out of Y!
FAST Enterprise Crawler/6 (www.fastsearch.com) is crawling
walkman



 
Msg#: 1819 posted 9:11 pm on Mar 2, 2004 (gmt 0)

is this too part of Y! crawl team or just Slurp? I remember Tim saying that they're adding pages from the Fast crawler too, but Enterprise Crawler? I haven't checked my past logs for this but looks like it's indexing the main links from the front page.

Slurp loves my site, it shows up several times a day but gets just the robots.txt. :). A penalty over the .net, .org pointing to the .com was one thing I came up with. I e-mailed them a few days ago but no answer yet.

Could this be it, or should I wake up and stop dreaming?

On edit: Checked my logs from a week ago. Some 600 files in one day alone. I only have about 2000 or so pages. Let's hope.
Also: This spider is showing only on the site that wasn't already included on Y! serps. Checked the logs fo the other ones, nothing.

 

seindal

10+ Year Member



 
Msg#: 1819 posted 11:18 pm on Mar 2, 2004 (gmt 0)

I have the same problem with slurp taking only robots.txt, and I have written to Y! about it, but no reply and no change.

I have no reason to believe the site is banned.

René

walkman



 
Msg#: 1819 posted 11:25 pm on Mar 2, 2004 (gmt 0)

see if this FAST Enterprise Crawler/6 (www.fastsearch.com) is crawling. You never know.

seindal

10+ Year Member



 
Msg#: 1819 posted 11:37 pm on Mar 2, 2004 (gmt 0)

nope.

walkman



 
Msg#: 1819 posted 12:16 am on Mar 3, 2004 (gmt 0)

don't know what to say, I'm puzzled too. This is the IP 66.151.181.4.

2_much

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 1819 posted 12:40 pm on Mar 3, 2004 (gmt 0)

I'm not entirely sure, but I believe Fast Enterprise is an entirely different product that is not even owned by Yahoo. I'll try to find out more about this.

I did hear at a Yahoo presentation that if the spider is only requesting a robots.txt but is not indexing the site, there is a good chance the sites is banned or penalized.

Yahoo may respond to you, but you might want to consider paying for your url to get indexed via Site Match because that will get the site reviewed by an editor.

Part of the idea of Site Match is that you can pay to have customer service so you can have these sorts of problems corrected.

seindal

10+ Year Member



 
Msg#: 1819 posted 1:27 pm on Mar 3, 2004 (gmt 0)

That would be a nice way to make money. Ban random sites to make them pay to be reinstated. If they can't make a positive incentive to pay, make a negative incentive.

I'll wait and see before I pay. The site has been out of their index for many months, and it has done quite well without Y! traffic, so I'm not quite desperate enough yet.

walkman



 
Msg#: 1819 posted 1:48 pm on Mar 3, 2004 (gmt 0)

"Part of the idea of Site Match is that you can pay to have customer service so you can have these sorts of problems corrected."

I wish it made economical sense for me to pay $25 a page and than 30 cents a click. It would be $25K to start and then $300 a day for just a click each. I'd need to make $400 profit a day just to pay for Yahoo.

Sadly the Enterprise is separate, just checked it too. Scooter showed up too but I guess Y! didn't share the penalized sites' list yet.

caveman

WebmasterWorld Senior Member caveman us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 1819 posted 3:06 pm on Mar 3, 2004 (gmt 0)

Yahoo may respond to you, but you might want to consider paying for your url to get indexed via Site Match because that will get the site reviewed by an editor.

Part of the idea of Site Match is that you can pay to have customer service so you can have these sorts of problems corrected.

That's a great point that I, for one, had not thought of at all. People have been saying for years that they'd pay for G or any other major SE to review their site when an apparent penalty was in place.

I wonder if it will be possible to indicate upon site submission that part your reason for submitting is to have Y! respond to possibility penalties that might exist, possibly even with some feedback? Now that would be useful, especially to those who really want to practice SEO but stay clearly on the right side of the lines...

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Yahoo / Yahoo Search Engine and Directory
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved