Forum Moderators: phranque

Message Too Old, No Replies

transferring large files

         

bheybugarin

11:46 pm on Jun 26, 2004 (gmt 0)

10+ Year Member



Hello,

I use a dial up Internet access and working at home.

I have more than 100MB html files to be upload in the web server and its hard to FTP it.

I use WS_FTP for transferring files. Any suggestions and solution to upload the files more faster?

Im using Linux web server.

Your suggestions will be a great help.

danieljean

2:39 pm on Jun 27, 2004 (gmt 0)

10+ Year Member



100Mb html file? wack! Whatever do you have such a large file for?

In any case... assuming you can ssh into your server, compress it (zip, rar, whatever) before uploading. You probably bring that down to around 15Mb, then log on to your server and unzip.

There might be a way to upload more effectively. For downloading wget lets you set a switch so if your transfer gets interrupted, it doesn't have to start all over again. Anyone know if there is a similar tool for uploads?

uncle_bob

5:10 pm on Jun 27, 2004 (gmt 0)

10+ Year Member



trying to shift a 100mb file over dialup or a bad connection is hardwork. My advice is to not just zip/rar/etc it first, but use spanning, so it creates say 10 or 20 small archives rather than 1 big archive.

Then start uploading the files, and once a file is transfered you don't need to transfer. That way even if the line drops you at least have transfered some whole files, and just need to carry on until they are all uploaded. Once you have all of the archives transfered, unzip/etc the files on the other end.

bheybugarin

2:06 am on Jun 28, 2004 (gmt 0)

10+ Year Member



Thanks for your some tips!

My html files are only 6-10KB but its almost 18,000 pages.

I will try to ZIP it and upload in the server.

vkaryl

2:35 am on Jun 28, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Jeez....

How about a cron job that will upload each single 8-10 kb file late at (your) night? That would probably be the least stress of anything - assuming your connect will stay alive that long without "intervention".

bheybugarin

8:41 am on Jun 28, 2004 (gmt 0)

10+ Year Member



I already ZIP them and try to upload a zip file to the server containing 4MB.

My problem now is, how can I unzip the zip file using SSH. My zip file is: collect1.zip

Please let me know if the command below is correct after I connect to the LINUX server and will unzip the collect1.zip

gzip -c -d collect1.zip ¦ tar xf -

Leosghost

12:34 pm on Jun 28, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Get Cute FTP Pro ...it will make your life much easier if you do this kind of stuff...

uncle_bob

2:44 pm on Jun 28, 2004 (gmt 0)

10+ Year Member



If you used winzip (or equivalent) to zip up the files on your pc, then you need to use unzip on the server, not gzip ¦ tar.