homepage Welcome to WebmasterWorld Guest from 174.129.76.87
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Yahoo / Yahoo Search Engine and Directory
Forum Library, Charter, Moderators: martinibuster

Yahoo Search Engine and Directory Forum

    
Yahoo spider
Anyone else seen this?
Fusioneer

10+ Year Member



 
Msg#: 16 posted 2:41 am on Jan 18, 2001 (gmt 0)

This little sucker just pops in every couple of weeks and retrieves index.html from one of my sites. No other files - just index.html. Like a link checker.

2001-01-17 16:15:12 wr13.yahoo.com - GET /index.html Mozilla/4.0,+-,+-,+- 200 0 3338 69 1453 HTTP/1.0 Mozilla/4.0 - -

This site is not listed in Yahoo but we have applied 4-5 times before noting that their policy requires sites to be viewed without any plugins. This site uses Flash and states you must have Flash installed to proceed beyond the home page.

In discussions with someone I know from another SEO company I have been told that Yahoo does not use editors to review/select sites for inclusion, it spiders with a Mozilla agent using predefined criteria that browses using a more "natural" behaviour. Said info was supposed to come from someone they knew inside Yahoo.

All hearsay of course but this little beggar is annoying me. Anyone else care to shed some light on this?

- Fusioneer

 

Laisha

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 16 posted 4:22 am on Jan 18, 2001 (gmt 0)

>In discussions with someone I know from another SEO company I have been told that Yahoo does not use editors to review/select sites for inclusion...

If I understand what you're saying, there are many people who believe they do have editors who "rove" the internet looking for sites. It makes sense to me, as well, that they do, given the "mysterious" appearance of many listings which have not been submitted.

As luck would have it, there is the beginning of a discussion about just that thing in this thread [webmasterworld.com]. :)

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Yahoo / Yahoo Search Engine and Directory
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved