Forum Moderators: phranque

Message Too Old, No Replies

My host claim I have Exceeded disk space

Im not so sure.

         

mack

1:42 pm on Aug 1, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



About a month ago I bought a new domain name. I logged in to my hosing company control panel went to toolbox and bought it from there. It asked if I wished web space to go with the domain I clicked yes and bought 20meg for the new site. Today I finished the new site and tried to upload it. I was given an error by my FTP client “disk allocation has been exceeded”. There are no files associated with this new site. I called my hosting company and was told that the 2 domains where sharing a server and if one site uses up more space it will take over the space allocated to the new domain. The entire space that I have available is 70meg. I have been told I have exceeded this. When I use my FTP client to access the site and I go to my root directory and right click then go to properties. It eventually tells me that the entire file size of the site is 52meg, when I questioned them about this the guy simply said you are on Windows we are on Linux, these 2 systems measure file sizes in a different way. Do I have a case or is he right? Just under 20meg of difference is a large amount to simply be due to a different OS????

Nick_W

1:46 pm on Aug 1, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



this the guy simply said you are on Windows we are on Linux, these 2 systems measure file sizes in a different way.

What rot! 1mb is 1mb whatever the platform!

Do you have ssh access?

Nick

mack

1:49 pm on Aug 1, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



This is exactly what I said to him...a tone of bricks is the same as a tone of feathers

No I dont have ssh access, just FTP?

Nick_W

1:51 pm on Aug 1, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I think you may be hard pushed to verify it on there server through FTP.

The only other way I can think of is to download the entire 2 sites, and the log files and any other bits, stick 'em in one folder on your machine and check out the properties. I think that gives you the size in windows?

Nick

korkus2000

1:52 pm on Aug 1, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



How big is your current site on your computer? You bought 20 megs of storage, and they are not giving you that?

mack

1:53 pm on Aug 1, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



I dont have acess to the logs with ftp they have webaliser installed. from my control pannel i can download the log files and view stats using wapaliser.

When i log in using FTP first folder i see is called

www.my_site.com

[edited by: mack at 1:55 pm (utc) on Aug. 1, 2002]

Knowles

1:54 pm on Aug 1, 2002 (gmt 0)

10+ Year Member



Ive noticed small differences in file sizes between linux and win on ftp clients but nothing more than a bite or 2. So that would have to be alot of files. I would say go with what Nick suggested, download everything to one folder and check the properties.

korkus2000

1:58 pm on Aug 1, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Even if you get the file size on your computer I don't think that is going to change anything with their oppinion. You might want to start looking for alternitives.

bird

2:01 pm on Aug 1, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Two possibilities:

a) The actual size of a file on disk is not only determined by the contents of that file, but also by the block size of the file system it is stored in. If your own box uses a blocksize of 1kb, and the server one of 2kb, then you're losing an average 1kb per file when uploading. This has nothing to do with the OS used, but can be different on each machine with any OS. In general, large disks use larger block sizes than small ones.

b) Stuff you did on the server (even the uploading) may have left garbage in some temp directory, which isn't automatically cleared, but still counts for your quota.

Knowles

2:01 pm on Aug 1, 2002 (gmt 0)

10+ Year Member



make sure you own those domains as well! You said you purchased it through your control panel. Hopefully you do other wise you are sort of at their mercy as to what they want to give you. Another possiblity is that the way they are counting your space is not just the files you upload. It could be your logs as well. If they do not delete them you may be falling into problems there.

mack

2:12 pm on Aug 1, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Ok i sorted al the directories i use on the site into one folder and it weighed in at just under 53meg I also have MYSQL so the db for that is another 5 meg (forgot about that one)

so I am thinking I have used about 57meg??? they say I have used 70

the site contains just over 3500 files do you think the block size would add up to the remainder???

Nick_W

2:22 pm on Aug 1, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I don't think so, but I'm not the expert here. Don't most linux systems use 1024 like Win or am I dribbling rubbish again?

Nick

Knowles

2:25 pm on Aug 1, 2002 (gmt 0)

10+ Year Member



3500 items? Are they all in one folder? The folder itself takes up a space as well.

How sure are you on the DB size?

bird

2:27 pm on Aug 1, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



so I am thinking I have used about 57meg??? they say I have used 70

the site contains just over 3500 files do you think the block size would add up to the remainder?

That would mean a loss of 3.7 kb per file. I just checked and found that my own /home partition of less than 10 GB uses a block size of 4kb. If the partition on your server is significantly larger (eg 80+ GB), then a block size of 8 kb would be possible, explaining the difference (the average loss is half the block size per file).

Of course, there's still the possibility that your log files are also counted, so you might want to ask them about that.

Gibble

2:45 pm on Aug 1, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



log files are often included in total used space, do you have log files taking up space?

bird

2:48 pm on Aug 1, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Don't most linux systems use 1024 like Win?

This has nothing to do with the operating system. The block size is determined by the file system, and should be variable with all up to date implementations, even under Windows. It is possible that good old FAT couldn't do more than 1 kb, but that's really not very useful for large disks. With a decent system setup, the user can specify the desired block size during installation, although some dumbed down formatting routines may try to make a guess without telling you about it.

The optimal block size depends on both the size of the partition as well as the typical (not average!) size of the files that will be stored there. If you make the blocks small, then you may get too many of them, so that the block management structures (inodes on unix) take more space on the disk than you're gaining by reducing the slack per file. If they're too big, then each file will waste more space than necessary. There's no "one size fits all" here.

3500 items? Are they all in one folder? The folder itself takes up a space as well.

While this is true, you shouldn't forget that directories/folders are also just files on a technical level, subject to the same block size boundaries. Storing large numbers of files into one directory may create other performance problems, but for our type of counting here, a directory is just another file that should be included with that number of 3500.

I also have MYSQL so the db for that is another 5 meg

This reduces the difference to 8 MB, and the average loss per file to 2.3 kb (ignoring the directories). Therefore, the block sitze of your server is most likely 4 kb, which sounds very reasonable. You'll just have to live with the fact that your files eat more space there than on your local disk.

diddlydazz

2:51 pm on Aug 1, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Basically I would be looking for more space or a different host. It sounds as if you *have* used all your space but they *should* have told you that the space would be shared with your other domain.

Dazz

engine

3:41 pm on Aug 1, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Log files - agree with what was said there.

Also, on a general point, disk space is really cheap - if you need the space, get more, it "shouldn't" be expensive.

mack

2:05 am on Aug 2, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Yes they are very keen to sell me additional space. I normaly just buy it through my control pannel when I log in. I wish I had knows they where going to install my new domain on the same root as my existing domain. Had I known this I would have set up a new account.

engine

10:28 am on Aug 2, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



That's not good practice by keeping these things quiet from you.

I'd seriously consider a new host with greater flexibility.

gsx

12:41 pm on Aug 2, 2002 (gmt 0)

10+ Year Member



Each operating system (and even versions of) stores files differently. It can also depend on the size of hard disk as to how it stores the files.

If you have 3500 files that all consist of one character, you expect to have used 3500 bytes of the hard disk. This is not true:

Each file will be allocated a minimum block size. Windows in some circumstances may allocate a minimum of 16k per file. This means that you will use 3500 x 16k for the above files = 56000k or about 55Mbytes (! sounds bad !).

You may find that Linux may be less economical in some circumstances and may allocate a minimum of 32k per file, thus using double the amount above: 110Mbytes.

On top of that, each file will have a filename, that has to be stored somewhere. If the average filename length is 10 bytes, there is another 34k of data stored, then it has to store the time the file was created and updated (min of 4 bytes each, more likely to be 8 bytes), the file length, index map of various parts of the file (files are not always stored in one long block, you find a bit here and a bit there - the index points the file system in the right direction, but takes up space).

There is a lot to consider.

If the minimum block size is 4k, a one byte file will take space in the directory index plus 4k. If the file was 4k, it would take exactly the same amount of space. But if it were 4k + 1byte, it would need an extra block, and it would take up space in the directory index plus 8k (2x4k).

mack

1:11 pm on Aug 2, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



I found a very temporary work around. :)

When I mentioned 3500+ files most of you would have probaly realised most of my side is DB driven. What I did was to compress the file size of my tempate HTML files. Generaly I removed as much "white space" as I could, all <!--notes--> and un nescasery <tags>. Managed to reduce my template by about 10% 3500 files all 10% smaller certainly ads up. Im now 8 meg below alocation.
:)