homepage Welcome to WebmasterWorld Guest from 54.227.11.45
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Visit PubCon.com
Home / Forums Index / Yahoo / Yahoo Search Engine and Directory
Forum Library, Charter, Moderators: martinibuster

Yahoo Search Engine and Directory Forum

    
Should I get excited? So far I've been out of Y!
FAST Enterprise Crawler/6 (www.fastsearch.com) is crawling
walkman




msg:830076
 9:11 pm on Mar 2, 2004 (gmt 0)

is this too part of Y! crawl team or just Slurp? I remember Tim saying that they're adding pages from the Fast crawler too, but Enterprise Crawler? I haven't checked my past logs for this but looks like it's indexing the main links from the front page.

Slurp loves my site, it shows up several times a day but gets just the robots.txt. :). A penalty over the .net, .org pointing to the .com was one thing I came up with. I e-mailed them a few days ago but no answer yet.

Could this be it, or should I wake up and stop dreaming?

On edit: Checked my logs from a week ago. Some 600 files in one day alone. I only have about 2000 or so pages. Let's hope.
Also: This spider is showing only on the site that wasn't already included on Y! serps. Checked the logs fo the other ones, nothing.

 

seindal




msg:830077
 11:18 pm on Mar 2, 2004 (gmt 0)

I have the same problem with slurp taking only robots.txt, and I have written to Y! about it, but no reply and no change.

I have no reason to believe the site is banned.

René

walkman




msg:830078
 11:25 pm on Mar 2, 2004 (gmt 0)

see if this FAST Enterprise Crawler/6 (www.fastsearch.com) is crawling. You never know.

seindal




msg:830079
 11:37 pm on Mar 2, 2004 (gmt 0)

nope.

walkman




msg:830080
 12:16 am on Mar 3, 2004 (gmt 0)

don't know what to say, I'm puzzled too. This is the IP 66.151.181.4.

2_much




msg:830081
 12:40 pm on Mar 3, 2004 (gmt 0)

I'm not entirely sure, but I believe Fast Enterprise is an entirely different product that is not even owned by Yahoo. I'll try to find out more about this.

I did hear at a Yahoo presentation that if the spider is only requesting a robots.txt but is not indexing the site, there is a good chance the sites is banned or penalized.

Yahoo may respond to you, but you might want to consider paying for your url to get indexed via Site Match because that will get the site reviewed by an editor.

Part of the idea of Site Match is that you can pay to have customer service so you can have these sorts of problems corrected.

seindal




msg:830082
 1:27 pm on Mar 3, 2004 (gmt 0)

That would be a nice way to make money. Ban random sites to make them pay to be reinstated. If they can't make a positive incentive to pay, make a negative incentive.

I'll wait and see before I pay. The site has been out of their index for many months, and it has done quite well without Y! traffic, so I'm not quite desperate enough yet.

walkman




msg:830083
 1:48 pm on Mar 3, 2004 (gmt 0)

"Part of the idea of Site Match is that you can pay to have customer service so you can have these sorts of problems corrected."

I wish it made economical sense for me to pay $25 a page and than 30 cents a click. It would be $25K to start and then $300 a day for just a click each. I'd need to make $400 profit a day just to pay for Yahoo.

Sadly the Enterprise is separate, just checked it too. Scooter showed up too but I guess Y! didn't share the penalized sites' list yet.

caveman




msg:830084
 3:06 pm on Mar 3, 2004 (gmt 0)

Yahoo may respond to you, but you might want to consider paying for your url to get indexed via Site Match because that will get the site reviewed by an editor.

Part of the idea of Site Match is that you can pay to have customer service so you can have these sorts of problems corrected.

That's a great point that I, for one, had not thought of at all. People have been saying for years that they'd pay for G or any other major SE to review their site when an apparent penalty was in place.

I wonder if it will be possible to indicate upon site submission that part your reason for submitting is to have Y! respond to possibility penalties that might exist, possibly even with some feedback? Now that would be useful, especially to those who really want to practice SEO but stay clearly on the right side of the lines...

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Yahoo / Yahoo Search Engine and Directory
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved