homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Yahoo / Deprecated - Altavista, Alltheweb.com
Forum Library, Charter, Moderator: open

Deprecated - Altavista, Alltheweb.com Forum

Indexing SERPs
Did I miss something?

 8:43 am on Feb 19, 2002 (gmt 0)


I have just been checking a few things out on Fast and when checking backward links quite a few results from other search engine queries were appearing in the SERPs. Now I wouldn't be surprised about SEs indexing directories, but these are keyword generated.

I have never submitted any SERPs to any SE but results were appearing from google, yahoogle, AV and Lycos. I was wondering how they might have got there - surely someone must have submitted them.



 6:00 am on Feb 20, 2002 (gmt 0)

Robber you are right - didn't see the heavy weights, but some minor engines, even meta engines, serps. Strange. Tend to believe though it#s not necessarily submitted serps but comes from Fast's webcrawler army gone wild lately.


 6:58 am on Feb 20, 2002 (gmt 0)


by "webcrawler army" are referring to a human army or Fast's spider. I can only imagine it would be human - it would be a bit of a worry if their spider is now clever enough to do keyword searches!

It would make sense because the submitted SERPs appear to be in clusters relevant to a theme, the reviewer could have been searching on this theme with variations of similar keywords and adding the SERPs.

Seems like a very strange strategy.


 7:07 am on Feb 20, 2002 (gmt 0)

I have a SERP as a backlink from MSN, it has been there for 2 months now and shows up in AOL, Hotbot and a few others.

Very strange, 1 month I could understand but 2 months ?



 7:55 am on Feb 20, 2002 (gmt 0)

They typically come from someone either hard coding a search into a link, or using SSI to load a serp into a page.

I too have seen a fair amount of this in Fast, but I don't recall seeing any from Google. Most major engines exclude their search directory from crawlers. And even if you ignore Google's robot.txt and try to crawl their SERPS, you get back blank pages. (at least that's what I've heard. I'd never consider trying such a thing myself).:)


 7:59 am on Feb 20, 2002 (gmt 0)

I think they are back spidering referrals.


 11:59 pm on Feb 20, 2002 (gmt 0)

You might be right about Google, just took another look and couldnt see any from Google, however, there is definitely Yahoogle in there.


 1:06 pm on Feb 20, 2002 (gmt 0)

Could someone send me a keyword in stickymail to a search where this is happening?


 5:21 pm on Feb 20, 2002 (gmt 0)

Should be in your sticky now.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Yahoo / Deprecated - Altavista, Alltheweb.com
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved