Welcome to WebmasterWorld Guest from 18.204.48.199

Forum Moderators: open

Message Too Old, No Replies

Firefox macro/cron?

or possibility another solution?

     
10:59 pm on Apr 26, 2005 (gmt 0)

Junior Member

10+ Year Member

joined:July 18, 2003
posts:63
votes: 0


I want to be able to grab a page from the web that is behind a login and save its contents to a file. Previously I've written PHP scripts to do things like this, but for some reason I can't get it to work on this site even passing through the cookies that are set after login.

So, is there any way I can get a web browser (probably Firefox would be easiest) to collect the data from a URL periodically and write it to a file?

If not, is there a way to get something like links/lynx to do this on the command line in combination with cron?

I'm sure this must be possible in a number of ways, but I can't seem to do it at the moment :(

The site in question saves login details between sessions, so it shouldn't be neccesary to negotiate a login each time. Simply present the appropriate cookies, grab the page content, and save it.

Can anyone make any suggestions please?

12:02 am on Apr 27, 2005 (gmt 0)

Junior Member

10+ Year Member

joined:July 18, 2003
posts:63
votes: 0


well, as a quick follow-up. I managed to use elinks with the -source option in combination with cron to get it done.

However, I'd still be very interested if anyone knows how something similar could be achieved with firefox