php based crawler

or perl is fine

[issekun]

hey guys..

the problem is, im trying to make a central portal so that all of ma frieds blogs recent post can be seen on it. so that its easy to see who posted wot and all...

the process needs to be that when i add a URL, the crawler then keeps cheking on the URL's. if theres a new post made it has to appear on ma central portal with the title and descriotion..

so is there a way to do this or any script out there that is currently doing this..

thanks in advance

[coopster]

I would search the open source repositories such as sourceforge, hotscripts, freshmeat, phpclasses.org ... see if you find something there. I recall seeing one once called phpspider or something like that.

[elgumbo]

Do your friends blogs produce an RSS feed? If they do you could use that to show their latest posts.