Forum Moderators: coopster

Message Too Old, No Replies

PHP CURL scraping problem

         

Elric99

9:41 am on Apr 7, 2010 (gmt 0)

10+ Year Member



Hello,

I'm using CURL to get info from various pages but need a way to scrape the page after all javascript and other scripts have rendered. To scrape the actual page people see, as this often differs from what CURL sees.

eelixduppy

2:16 pm on Apr 30, 2010 (gmt 0)



Pretty sure you can't do this because if anything is being rendered by JavaScript, that is something the browser does, not the server. Since you are making the request to the server, then you'd have to parse the javascript yourself, which is a task I doubt you want to take on. ;)

brotherhood of LAN

2:29 pm on Apr 30, 2010 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



If it's screenshots you are after, there are various open source options out there, mostly depending on what browser and OS you are using.