Why Can't I Copy a Large File Despite Having Larger Free Space?

In these days of extra large hard disks many try to copy large files from a DVD but find that can't even though there is plenty of free space on the hard disk. Why not?

The most likely cause for this is not some sort of copy protection but that the file being copied is too large for the file system to handle. Windows XP allows you to format a hard disk in two different file system formats: FAT32 and NTFS. These file systems differ in the size of file they can handle. FAT32, for example, can only handle files up to 4GB in size. When it was developed, that size file was almost unheard of but now, a DVD can have files that large or larger routinely. So, if you are trying to copy a movie from a DVD onto your FAT32-formatted hard drive it likely won't copy as most full-length movies are files larger than 4GB.

FAT32

The original File Allocation Table (FAT) file system was introduced in 1977 and generally applied to floppy disk storage. It was later modified to work with hard disks and other removable media. FAT had a problem however; it could only manage spaces up to 2GB in size. As Windows came into being and programs became larger, the 2GB barrier became a serious problem. Thus, in 1996, with the OEM Service Release 2 (OSR2) of Windows 95 (also known as Windows 95b) came a FAT enhancement known as FAT32.

The two major features of FAT32 that improved upon the original FAT (or FAT16 as it's sometimes known) are the disk efficiency and size of the disk supported.

Files are stored in clusters on the disk. The size of the clusters depends on the size of disk. Under FAT, drives over 1.2GB used clusters that were 32K in size as the file allocation table itself could not track more clusters because of it's 16-bit structure. The 32-bit structure in FAT32 allows disks of that size to use 4K per sector. This improves efficiency as a file, no matter how small, will always use at least one cluster and the space in the cluster not used is wasted. FAT32 doesn't start to use 32K clusters until the disk goes over 60GB in size and can handle disks up to 2TB (terabyte or trillion bytes); though not all operating systems can deal with disks that size even if the file system can.

There are many other features changed between the two but these are the major ones to be concerned with.

The problem that many encounter now is one of the limits of FAT32 that's being run into: file size. The original FAT (FAT12) had a maximum file size of 32MB, FAT16 has a maximum file size of 2GB, and despite the much larger hard disk size supported by FAT32, the maximum file size only doubled to 4GB.

This is largely why a movie file larger than 4GB in size might not be able to be copied to a hard disk with lots of space. The hard disk is probably formatted using FAT32. There is no quick solution short of converting the hard disk to the NTFS file system.

NTFS

The New Technology File System (NTFS) was introduced in Windows NT (mid-1993) and is available in different forms in all following products: Windows 2000, Windows XP, Windows Server 2003, and Vista. It replaces FAT and FAT32 although some operating systems allow you to format disks as either FAT32 or NTFS. You can convert FAT32 disks to NTFS with little problem however going back from NTFS to FAT32 may not be possible due to FAT32 limitations that NTFS does away with (e.g., file size as seen above).

NTFS makes a number of improvements over FAT-based file systems. It uses advanced data structures, has a B+ tree directory structure, has improved reliability and use of disk space, allows for extensions such as security control, and has both a hard disk and file size of 16 EiB (EiB = exbibyte; a contraction of exa binary byte, and equaling 1,152,921,504,606,846,976 bytes).

So, if you need to copy files larger than 4GB, you need to make certain that the file system on the hard disk you are copying to is NTFS and not FAT32. Unfortunately, many portable USB hard disk drives come formatted as FAT32 in order to interface with the maximum number of operating systems.

[Added from comments] You can use a Windows Command Prompt command to convert a FAT volume to NTFS. Open a Command Prompt window (Start | type CMD and Enter into the search dialog to open a window). To see the full syntax of the command and to verify that the command is present in your version of Windows type (no quotes) "CONVERT /?" at the command prompt and hit Enter. This should give you the help and if it comes up you have the command available to use. The command to convert any drive from FAT to NTFS would then be: CONVERT d: /FS:NTFS where d: is the drive letter of the disk/volume you wish to convert. If you want to watch the details add a /V (for verbose) to the command. Also, to enable all users to access the drive, just in case you might want to also add /NoSecurity to the command line. These latter two are optional and usually not needed.

More Information


Comments (18)

steve kirsten
Said this on 2009-08-19 At 04:47 am
A very good article. All information about FAT in one place.
Thanks.
mxhxr
Said this on 2009-11-20 At 12:04 pm
Great write up, thank you!
Kisina Denis
Said this on 2009-11-26 At 08:54 am
Very Informative, just stumbled by this site by mistake. But am going to make it my friend from now onwards Didn't know that
anand
Said this on 2009-12-21 At 10:42 pm
very nice article

the command for converting fat32 to ntfs is as follows

Start > Run > Cmd

convert d: /fs:ntfs

where d: is the drive letter of the external disk.
Vicky
Said this on 2010-01-02 At 09:00 am
Thanks anan, this info was extremely helpful. When I tried to do Format it showed only FAT32 option but with this command it converted to NTFS. Now I can copy large files!
clubber
Said this on 2010-01-17 At 11:34 pm
"the command for converting fat32 to ntfs is as follows..."
Thanks Anand. Worked perfectly, was trying to copy an 8gb movie to a 16gb usb stick and kept getting the disk is full (brand new and freshly formated). After I ran that it copied no problems.
jim
Said this on 2009-12-29 At 10:05 am
Thanks for the info.
ripple
Said this on 2010-01-14 At 03:50 am
Microsoft has provided the recommended solution for this issue here : http://support.microsoft.com/kb/307881
capicar
Said this on 2010-01-19 At 02:40 am
Thanks 1000 for your precious informations, very easy and understandable!
You solved my problem with huge files.
Ann
Said this on 2010-01-19 At 03:05 am
Thanks for information!
darkunderscorestar
Said this on 2010-01-23 At 12:02 pm
That microsoft article didnt have my problem 'the drive is not clean' so i couldnt convert it. I ran chkdsk like prompted (it even ran it in the initial process) and to no avail it was a-okay. So I just went ahead and opened up admin tools via control panel then formatted my terabyte portable HDD over night...its been seven hours and its at 89%
DaBoss
Said this on 2010-01-23 At 02:42 pm
Sometimes a full format is the only way to change a drive but, frankly, I'm a bit surprised that a drive as large as that was FAT formatted to begin with and not NTFS formatted. The world of computers constantly throws curveballs. :-)
Robin Hood
Said this on 2010-02-07 At 02:26 am
Hi, I think it is happening again. MS has win7 out and xp must go, so
they do the same thing as with win98se, when it was at its end of life, and xp took over. It is the big file copy/delete etc that was then crippled. And now its the same with xp.
Damn M$.
davide
Said this on 2010-02-16 At 06:41 am
thank you very much! by far the best answer on the internet!

I was wondering if now my macor the PS3 at home will be able to read this file from the usb.
DaBoss
Said this on 2010-02-16 At 10:05 am
AFAIK the PS3 game system uses FAT32 and cannot read NTFS disks. So, it is limited to files smaller that about 4GB.
Haider
Said this on 2010-02-19 At 12:51 pm
Thanks very helpful article
George
Said this on 2010-02-23 At 03:40 pm
Thanks i needed this information for an external disk which came with FAT32 format , now i can move large files into it thanks again!!
weed4all
Said this on 2010-03-10 At 11:19 am
THNX man! U saved my life! Cheers!
Post a Comment
* Your Name:
* Your Email:
(not publicly displayed)
Reply Notification:
Approval Notification:
Website:
* Security Image:
Security Image Generate new
Copy the numbers and letters from the security image:
* Message: