Welcome to WebmasterWorld Guest from

Forum Moderators: bill & werty

Message Too Old, No Replies

RSS / Spiders

10:35 pm on May 11, 2005 (gmt 0)

New User

10+ Year Member

joined:Sept 21, 2004
votes: 0

Hey folks,

I found this site that helps you to pull RSS feeds quickly...


After you select your settings, it gives you a small piece of JS code to drop in your page.

My question is, will the news stories get spidered and cached or will the spiders ignore it completely?


1:28 pm on May 12, 2005 (gmt 0)

Moderator This Forum from US 

WebmasterWorld Administrator 10+ Year Member

joined:Dec 3, 2002
votes: 4

The content will not be seen because it is rendered/pulled client side...most spiders are not javascript compatable...google may be the exception, so if you want to mimic what most spiders would see view the page with javascript turned off.

Your best bet is to use a server side RSS parser, such as magpie, this will actually build the content into your page before it server to a visitor (spider or human).