Cache EXR to DWAB

This I wholeheartedly agree on. Often specifications directly contradict themselves too. I get the feeling that a lot of them are copied and pasted from multiple sources.

I guess it would be hard for someone writing a spec to leave themselves open to being challenged about any compromises on quality. It would be much easier to set a spec insisting on shooting RAW codecs only and all post production would need to use mathematically lossless codecs then saying, if the cinematographer knows what they are doing then shooting ProRes4444 will suffice or that post production can use visually lossless compression as long as the end result isnā€™t visually compromised.

How good would it be if production budgets were taken into account in regards to specifications. Most folks on here doing TVCs wonā€™t have these issues but those of us working on longform certainly do

Just for interest: been using DWAA for 5+years. Got the mill London to convert to this before I left. PIZ was the preferred choice but playback of them in Nuke was noticeably slower.

So we used DWAA for the majority of commercials.

There will always be the odd case with super strict QC depts that wonā€™t permit this workflow.

5 Likes

Could I please suggest upvoting this.

I have thought about it a lot and DWAA & DWAB compression just makes so much sense as a working format. Iā€™ve tried to push some grades hard compared to PIZ and they are visually lossless. I cannot see any artefacts or banding or anything that would create issues.

Using exr to transport log colour spaces is much more damaging than the level of compression DWA introduces.

2 Likes

Yes!
I get this all the time, damned annoying!!

2 Likes

Please give this a go and let us know how things go:

You can customize the cache & render formats using the stone+wire.cfg file. In the DefaultFileFormats section, just define this:
-find the following line:
#floatVideo=RAW

-Remove the # sign

-Define your custom float cache format (see list of supported compressions in the section)
floatVideo=EXR:DWAA

Save the file, restart Flame and when Creating or Modifying an existing project, select Cache & Renders / Legacy Configuration and you will see that the 16 & 32-bit fp format are now set to OpenEXR(DWAA).

https://help.autodesk.com/view/FLAME/2023/ENU/?guid=GUID-07E8517A-75E0-4979-B226-22D03A941060

8 Likes

will test this! nice!

only thing is we cant have prores and DWAB , but I can live with this I thinkā€¦

any hdden way to choose a different compression strength for DWAA/DWAB? i guess its 45 by default?

Let me check

cool yea I would obviously love to have DWAB or ProRes also as a option for 8/10/12 bit files while its not the technically BEST way to handle things it should be a option.

We will need to design a way to have a high precision mode for when we are given STMaps or WorldPossition, for example. Where DWA compression might negatively effect those passes.

It is tricky to solve this scenario. Especially if those passes get provided in a multi channel EXR :thinking:

We work almost entirely in ProRes and DWA but still use PIZ for our UVs or motion vectors we pre render.

whats the usecase for caching those?

i only use it for timeline caching so for me this works anything can be dwab thats in the cache because its just playback and never used downstream

if you precomp just go and use a writefile node

1 Like

I cache all media that I pull in from our server. Multichannel EXRs from CG run like butter if I cache but can be subject to slowdown, when our server is busy, if I do not.

I would like it to be a little bit like colourMgt. We can have a set of rules that are customisable but also over ridden if needed to.

Couldnā€™t you just write your lossless exr files to the same volume your framestore resides on? Then there is no difference between cacheing a Piz or reading it.

1 Like

We share setups between two countries sharing the same server (sync)

Have two write files then. One to your local volume and one to your media server. Sure, itā€™s a little bit manual but it is a valid workaround.

Agree though, I can see your point in this particular scenario.

thats pretty much why we went full lucid-link you just get all media from your nas as if it was cached, thats huge for us especially with heavy CG renders and especially in nuke.

i feel that pain, in this case i would probably just leave it all cache wise to piz and just render stuff as dwab to the nas.

for me dwab is great becaue i read my cache from a nas woth just 10Gbit. so its flipped for me, footage is local but cache is on a server.

2 Likes

Just finished work on a show that used HDE arriraw. Looked horribly compressed. Asked the rental shop that delivered the cameras, dailies, conform and vfx pulls if they could check their pipeline. Response was that the arriraws matched the EXRs delivered, so with my limited knowledge of HDE, Iā€™d be hesitant to recommend using it.

HDE is losless compressed its bit for bit identical to arriraw, there is no difference at all, absolutely zero.
its just like running zip compression over a word document ā€¦

this sounds like something went horrible somewhere but it cant be HDE.

the only downside with HDE is increased computationa as you have to uncompress it first, just like you do with R3D.

2 Likes

Youā€™re probably right. This was my first time working with this. Never seen something this bad with ProRes from Arri cameras.

this should be the absolute most uncompressed camera recording of any camera ever, redcode is lossy, prores is lossy, arrriaw is true actuall raw.

that really sounds like someone did something extremely horrible at whatever point.

I concur with Finn on this. It has nothing to do with HDE.

1 Like