homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Gold Sponsor 2015!
Home / Forums Index / WebmasterWorld / Community Building and User Generated Content
Forum Library, Charter, Moderators: rogerd

Community Building and User Generated Content Forum

Use RSS Baby!
Don't be afraid... TRY it! It will get you spidered!

10+ Year Member

Msg#: 530 posted 1:16 am on Jul 21, 2005 (gmt 0)

Not too long ago i started a thread with the question of "What can i do to get my forum spidered?"

Well i think i have found it, and the key... is RSS.

RSS = Really Simple Syndication and basically is a method of formatting summarized versions of your site's content and submitting it to other sites to use as their own. The other sites will list your rss Feed and in turn you get a bunch of inbound links.

So, what i did is turned ON the RSS option in vbulletin. This gave my site a sweet feed that i could submit to different RSS directories. I took the feed URL and went over to pingomatic and started submitting.

Fastforward about 2 months... my site moved up a PR point (pr4 now), but more importantly the site is getting spidered much more thoroughly.

By submitting my feed to a ton of direcotires i have inbound links pointing @ the majority of my threads and this gets the pages indexed QUICK.

G Seems to be taking it slow and steady with the inclusions of my threads, but its working. I can already see a TON in google and its like a 500% difference. Actual traffic from google is up, but the volume is up maybe 20% max.

I find almost no difference with Yahoo. The traffic i get from yahoo is minimal, probably like 30% of what google brings in, and according to my awstats, yahoo doesnt slurp me that often.

OMG MSN loves it lol. After setting up the RSS feeds and submitting them to the directories daily i have seen MSN go buck WILD on my site. It spiders around 80% more gigs than google does and has ranked my in some great spots for keywords that are totally relevant to the content being discussed. I think MSN really likes NEW fresh content and when you have your content and new inbound links showing up on sites that update frequently... AND your site is always growing (like a forum does with each post and threaD) it is very appealing to MSN.

I would love for some others to try this out and tell me how it goes for you. It cant do anything but good and if your forum script already supports RSS then why not? Now go make some $$




WebmasterWorld Administrator rogerd us a WebmasterWorld Top Contributor of All Time 10+ Year Member

Msg#: 530 posted 6:31 pm on Jul 21, 2005 (gmt 0)

zigx, are you still submitting manually, or can you ping the directories automatically?

I've noticed fairly similar spidering behavior from the big three, BTW, without RSS.


10+ Year Member

Msg#: 530 posted 9:36 pm on Jul 22, 2005 (gmt 0)

What i did is used pingomatic to generate the URL that is actually giving my pings then i setup a cron job to just wget that url like twice a day.


10+ Year Member

Msg#: 530 posted 9:44 pm on Jul 22, 2005 (gmt 0)

Also, regarding the directories. i purchased a program for submitting RSS feeds (i highly suggest people do NOT buy any applications to do this, it can be scripted by your webmaster/admin very easily.)... so i run that every few days and it automates somewhat, but pingomatic is the best i think.

Global Options:
 top home search open messages active posts  

Home / Forums Index / WebmasterWorld / Community Building and User Generated Content
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved