Forum Moderators: coopster

Message Too Old, No Replies

Screen Scraping Solutions - Maintain Sessions?

Is this possible to scrape a site, but maintain sessions?

         

netnerd

3:39 pm on Apr 23, 2004 (gmt 0)

10+ Year Member



I have an affiliate deal with a company who have given me a number of affiliate urls to run in a frame.

Their branding is included in the site, and I want to remove this. I have their permission to do this.

The urls use sessions.

Is there a way to include these urls in my pages (with the branding stripped out), and maintain the sessions?

Im thinking i need to use CURL or sockets and run everything in an IFRAME .

any tips?

Its a linux server.

Perhaps there is software or scripts already avaible for this?

jatar_k

5:06 pm on Apr 24, 2004 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



You need to pull content into your site and maintain sessions on theirs?

I think curl will work but i am not totally sure.

netnerd

5:20 pm on Apr 24, 2004 (gmt 0)

10+ Year Member



Yeah - im told there is a way to do it with CURL

jatar_k

6:26 pm on Apr 24, 2004 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



have you read through this CURL, Client URL Library Functions [ca.php.net] or curl [curl.haxx.se]