What's your favorite flavor of EXR compression?

Looking for that balance of speed vs file size.

  • Scanline
  • Multi_Scanline
  • RLE
  • PXR24
  • PIZ
  • DWAB
  • DWAA
  • B44A
  • B44
  • Uncompressed

0 voters

And to even open this up further, it would be nice to have a single place where all this information lives. So let’s collect everything we know about EXR compression in this thread.

So if you know what compression nuke likes, etc., please share that here.

3 Likes

PIZ is lossless and usually the best option for images captured with a camera (as opposed to CGI).

PIZ has a better compression ratio than ZIP, so files will be smaller but are more computationally expensive to play back. Conversely, ZIPs take longer to write but are faster to read.

Wikipedia provides a nice summary:

2 Likes

Thanks!

Nuke likes zips the most - note there is a difference between zip and zips(1scanline), the name gives it away and nuke can then read like only half the scanlines at a time speedings things up.

Oh and btw ZIP compression is not your grandmas ZIP file compression , they have similarities but its not the same.

All losless conpressions will give you the same result the difference is in the encoding and decoding speed, you are very much trading storage bandwith for cpu cycles , its hust lioe choosing the different compression allgorithms in 7zip or keka or whatever, they wont change the file at all.

(another example of losless compression is FLAC)

Other thing to keep an eye out of is how the exr deals wirh multilayers, you can interleave the layers in different ways with “multipart” exrs beign what you want as those csn read a single channel from a exr those saving tons of bandwith.

Another thing is: dont put log or gamma encoded data into exrs, this comes down to that it saves data in floating point and not integer so 16bit float is definetely not the same as 16bit integer! 16bit float woth log data is bascially like 10bit DPX in terms of precision.

Why nobody has implemented things like compressed DPX is beyond me. (dpx-C exists)

compression; if you are not way too rich you use dwaa or dwab which is losssy compressed! … its like prores vs dpx while giving you all the nice exr festures like float data and multichannels and all the metadata in the world, dont be scared of dwaa, its great, you can vary the conpression yourself, 150 is like jpeg size in 16bit float!!

Last thing is that 32bit matters for 3D AOVs, like depth passes and UV(ST) maps. you can run into weird issues when you do 32->16 bit conversions with this data as rounding occurs.

Update actual last thing is; anyone that is requesting uncompressed EXR needs to rethink life. (Out of spite you shall compress them using 7zip before sending… or you should in genrall do that with uncompressed media but thats another story for another time)

4 Likes

I am very excited by DWAA compression.

EXR compression

A test, looking at EXR compression.

The clip was 50 frames long. Resolution 2240 x 1548

File format Size
EXR with DWAA compression 87.7 MB (≈1.75MB per frame)
EXR with PIZ compression 325.6 MB (≈6.51MB per frame)
EXR with ZIP single scanline (zips) compression 434.6 MB (≈8.69MB per frame)
ProRes 4444 for comparison 80.9 MB

image

I really do think that DWAA compression offers us something similar to the versatility and robustness of proRes. In my latest tests I am seeing data loss only in the crazy high values from the ACES test charts and in normal HDR photography there is no visible difference. I am not trying to be sloppy but I do see the benefit in being lean and mean when possible.

Have a look at another of my riviting pie charts :smile:
The clip was 111 frames long. Native resolution 4096 x 2160

File format Compression Size
12-bit DPX at native res Packed 4.4GB (≈39.8MB per frame)
16-bit EXR at native res PIZ 2.6GB (≈23.7MB per frame)
12-bit ProRes Quicktime 4444 661.5MB
8-bit JPG at native res 95% quality 208.3MB (≈1.9MB per frame)

image

7 Likes

Question. Regardless of exr compression, while archiving, it is saved as raw data , correct?

1 Like

Yes I believe so @AntonisNtelis

1 Like

Yes. Even if your project is set up as ProresLT archive is lossless data.

If I remember correctly prores archiving was an issues due to licencing. Exr though is open standard and it would be great if archive had an option for piz/zip.