homepage Welcome to WebmasterWorld Guest from 54.167.174.90
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Yahoo / Deprecated - Altavista, Alltheweb.com
Forum Library, Charter, Moderator: open

Deprecated - Altavista, Alltheweb.com Forum

    
Indexing SERPs
Did I miss something?
Robber

10+ Year Member



 
Msg#: 417 posted 8:43 am on Feb 19, 2002 (gmt 0)

Hi,

I have just been checking a few things out on Fast and when checking backward links quite a few results from other search engine queries were appearing in the SERPs. Now I wouldn't be surprised about SEs indexing directories, but these are keyword generated.

I have never submitted any SERPs to any SE but results were appearing from google, yahoogle, AV and Lycos. I was wondering how they might have got there - surely someone must have submitted them.

 

heini

WebmasterWorld Senior Member heini us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 417 posted 6:00 am on Feb 20, 2002 (gmt 0)

Robber you are right - didn't see the heavy weights, but some minor engines, even meta engines, serps. Strange. Tend to believe though it#s not necessarily submitted serps but comes from Fast's webcrawler army gone wild lately.

Robber

10+ Year Member



 
Msg#: 417 posted 6:58 am on Feb 20, 2002 (gmt 0)

Heini,

by "webcrawler army" are referring to a human army or Fast's spider. I can only imagine it would be human - it would be a bit of a worry if their spider is now clever enough to do keyword searches!

It would make sense because the submitted SERPs appear to be in clusters relevant to a theme, the reviewer could have been searching on this theme with variations of similar keywords and adding the SERPs.

Seems like a very strange strategy.

diddlydazz

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 417 posted 7:07 am on Feb 20, 2002 (gmt 0)

I have a SERP as a backlink from MSN, it has been there for 2 months now and shows up in AOL, Hotbot and a few others.

Very strange, 1 month I could understand but 2 months ?

Dazz

WebGuerrilla

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 417 posted 7:55 am on Feb 20, 2002 (gmt 0)

They typically come from someone either hard coding a search into a link, or using SSI to load a serp into a page.

I too have seen a fair amount of this in Fast, but I don't recall seeing any from Google. Most major engines exclude their search directory from crawlers. And even if you ignore Google's robot.txt and try to crawl their SERPS, you get back blank pages. (at least that's what I've heard. I'd never consider trying such a thing myself).:)

Brett_Tabke

WebmasterWorld Administrator brett_tabke us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 417 posted 7:59 am on Feb 20, 2002 (gmt 0)

I think they are back spidering referrals.

Robber

10+ Year Member



 
Msg#: 417 posted 11:59 pm on Feb 20, 2002 (gmt 0)

You might be right about Google, just took another look and couldnt see any from Google, however, there is definitely Yahoogle in there.

Brett_Tabke

WebmasterWorld Administrator brett_tabke us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 417 posted 1:06 pm on Feb 20, 2002 (gmt 0)

Could someone send me a keyword in stickymail to a search where this is happening?

Robber

10+ Year Member



 
Msg#: 417 posted 5:21 pm on Feb 20, 2002 (gmt 0)

Should be in your sticky now.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Yahoo / Deprecated - Altavista, Alltheweb.com
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved