FileSystem.stat() file sizes not correct for large files

zagortenej · April 14, 2024, 10:16pm

I wrote a quick script in Haxe to copy 100’s of large files from one disk to another and left it to run and some (long) time later I looked at the stats script wrote (using info from FileSystem.stat()) I saw these wild numbers and thought I messed something up, but it turned out I haven’t (yay!).

So, what I saw is if a file size is > 2GB FileSystem.stat().size is negative and if it is > 4GB then it (size) only contains the lower 32 bits of the file’s size.

This is true on eval, hl and neko targets, haven’t tried others.

It seems to be the result of Int being 32-bit sized on these targets.

Is this a bug? Shouldn’t size be haxe.Int64?

Igazine · April 15, 2024, 12:20am

github.com/HaxeFoundation/haxe

Large file support

opened 01:54PM - 20 Apr 20 UTC

ncannasse

In order to properly support files >2GB, we need to change the signature of `see…k` and `tell` method for `sys.io.FileInput`, using Float instead of Int, which is more easy to handle than Int64, and provides files sizes up to 9007 TB. seek() is not a problem, because passing Int will still work it might have 0 impact on user code, unless someone overrides it. tell() will change the return type so it might break some code relying on it. Alternative is to add seekLarge() tellLarge() operations but I don't like much people having to change their code once their hit 2GB limit.