Welcome to WebmasterWorld Guest from 50.17.114.227

Forum Moderators: open

Message Too Old, No Replies

Indexing SERPs

Did I miss something?

     
8:43 am on Feb 19, 2002 (gmt 0)

Preferred Member

10+ Year Member

joined:May 15, 2001
posts:462
votes: 0


Hi,

I have just been checking a few things out on Fast and when checking backward links quite a few results from other search engine queries were appearing in the SERPs. Now I wouldn't be surprised about SEs indexing directories, but these are keyword generated.

I have never submitted any SERPs to any SE but results were appearing from google, yahoogle, AV and Lycos. I was wondering how they might have got there - surely someone must have submitted them.

6:00 am on Feb 20, 2002 (gmt 0)

Senior Member

WebmasterWorld Senior Member heini is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Jan 31, 2001
posts:4404
votes: 0


Robber you are right - didn't see the heavy weights, but some minor engines, even meta engines, serps. Strange. Tend to believe though it#s not necessarily submitted serps but comes from Fast's webcrawler army gone wild lately.
6:58 am on Feb 20, 2002 (gmt 0)

Preferred Member

10+ Year Member

joined:May 15, 2001
posts:462
votes: 0


Heini,

by "webcrawler army" are referring to a human army or Fast's spider. I can only imagine it would be human - it would be a bit of a worry if their spider is now clever enough to do keyword searches!

It would make sense because the submitted SERPs appear to be in clusters relevant to a theme, the reviewer could have been searching on this theme with variations of similar keywords and adding the SERPs.

Seems like a very strange strategy.

7:07 am on Feb 20, 2002 (gmt 0)

Senior Member from GB 

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month

joined:Nov 27, 2001
posts:1156
votes: 2


I have a SERP as a backlink from MSN, it has been there for 2 months now and shows up in AOL, Hotbot and a few others.

Very strange, 1 month I could understand but 2 months ?

Dazz

7:55 am on Feb 20, 2002 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:June 26, 2000
posts:2176
votes: 0


They typically come from someone either hard coding a search into a link, or using SSI to load a serp into a page.

I too have seen a fair amount of this in Fast, but I don't recall seeing any from Google. Most major engines exclude their search directory from crawlers. And even if you ignore Google's robot.txt and try to crawl their SERPS, you get back blank pages. (at least that's what I've heard. I'd never consider trying such a thing myself).:)

7:59 am on Feb 20, 2002 (gmt 0)

Administrator from US 

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 21, 1999
posts:38047
votes: 11


I think they are back spidering referrals.
11:59 pm on Feb 20, 2002 (gmt 0)

Preferred Member

10+ Year Member

joined:May 15, 2001
posts:462
votes: 0


You might be right about Google, just took another look and couldnt see any from Google, however, there is definitely Yahoogle in there.
1:06 pm on Feb 20, 2002 (gmt 0)

Administrator from US 

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 21, 1999
posts:38047
votes: 11


Could someone send me a keyword in stickymail to a search where this is happening?
5:21 pm on Feb 20, 2002 (gmt 0)

Preferred Member

10+ Year Member

joined:May 15, 2001
posts:462
votes: 0


Should be in your sticky now.