Welcome to WebmasterWorld Guest from

Forum Moderators: bill & werty

Message Too Old, No Replies

RSS / Spiders



10:35 pm on May 11, 2005 (gmt 0)

10+ Year Member

Hey folks,

I found this site that helps you to pull RSS feeds quickly...


After you select your settings, it gives you a small piece of JS code to drop in your page.

My question is, will the news stories get spidered and cached or will the spiders ignore it completely?



1:28 pm on May 12, 2005 (gmt 0)

WebmasterWorld Administrator 10+ Year Member

The content will not be seen because it is rendered/pulled client side...most spiders are not javascript compatable...google may be the exception, so if you want to mimic what most spiders would see view the page with javascript turned off.

Your best bet is to use a server side RSS parser, such as magpie, this will actually build the content into your page before it server to a visitor (spider or human).


Featured Threads

Hot Threads This Week

Hot Threads This Month