Managing raw, file sizes and workflow

made about 2.5 TB of DPX files. After the edit was finished, we graded the DPX files at snails pace (I was the colorist and I wanted to die) and reconnected the DPX files. Export our Master and various versions for output. I can't imagine tackling a full feature with the same workflow.

Yea... Qantel Pablo can pull off uncompressed 4K with half a dozen cascades without breathing hard, and so can Mystika, but there's really not alot else out there that can match them... And they are not cheap...
 
When we used the Sony FS700 AXS-5R for a short film, we dealt with a nightmare of headaches for post. When we shot it, the R5 was barely out so the support for it was very minimal. We made dailies / proxies through Da Vinci Resolve and took the Sony RAW Viewer and made massive DPX files. We shot about 1 TB for a 10 minute short film (45-60 minutes of footage atleast) and then made about 2.5 TB of DPX files. After the edit was finished, we graded the DPX files at snails pace (I was the colorist and I wanted to die) and reconnected the DPX files. Export our Master and various versions for output. I can't imagine tackling a full feature with the same workflow. I hope the 4K DNG files are better implemented in Adobe's workflow this year. I need to also just buy Resolve outright so I can unlock the full possibilities of the software, then no worries about 4K RAW.

We will be releasing the short film online in a secret link. I will post it on here when I can, because most of that was shot on 4K and I think it is damn impressive for what our cameras can do. We shot it on the Schneider Xenar III's with Sony R5 recorder. Gorgeous footage.

Chris, I think you were, unfortunately, a little too on the forefront there. We shot a short film in 4K Raw off of the F55 this past summer, and originally we were going to go the proxy route, but after a lot of investigation, got the fool hearted idea to work with the Sony .mxf directly. It worked beautifully. Edited the entire film (2+ TB of Raw) in Premiere using the raw .mxf files. Fortunately, by the time we were ready for color grading this winter, Adobe released their Sony .mxf update, and we were able to direct connect the Premiere timeline to SpeedGrade and grade the raw directly that way. Startlingly simple workflow. I'm afraid the DNGs won't be anywhere near as easy in this case, but I'm still excited for them working with Adobe. Having to run all of our 2K Raw past Resolve before entering the Adobe system is a second step I'd love to eliminate.
 
Don't forget R5 records 16b with 3.5:1 compression so the 7Q's FS700 12b 4K uncompressed raw footage will be about 2.5x the size...

That's interesting Noah. So are you saying the Sony R5 does a compressed RAW? If so, is that possible to get a compressed RAW with the 7Q so we don't have those crazy file sizes? Seems like if the R5 could do it, the 7Q should be able to as well.
 
That's interesting Noah. So are you saying the Sony R5 does a compressed RAW? If so, is that possible to get a compressed RAW with the 7Q so we don't have those crazy file sizes? Seems like if the R5 could do it, the 7Q should be able to as well.


Thats true, the filesize is huge (its about 11.3MB per frame so 2.150Mbit/s) but a good solution (to store the data and even keep the flexibility and speed of DNG) is to compress the O7q DNGs direct from the SSD drive with DNG Compressor. So we end up with more economical lossless(!) compressed (zip-like) DNG files that are 40-50% the size of the original file. So you can do it even later and replace the uncompressed footage with the post-compressed one.
 
DNG Compressor? never heard about it, sounds interesting having reduced file size. could you tell us more about this tool and your workflow? tia
 
Ted, at the time we couldn't edit the MXF files native or else I would have. I edited Sony F55's XAVC right in Premiere on another film, no problemo. I was on the edge of my seat waiting for Adobe to release that October 2013 update to only find out MXF wasn't supported at all in the "Direct Link" feature to Speedgrade. What I did was graded the DPX files individually and then created LOOKs to be applied later in Premiere. It worked out well.

I think compressed RAW would be amazing. I use it on my DSLRs for photos all the time and see little to no loss in detail. So I hope CD can pull it off and muster up a compression option for all their RAW footage.
 
I think compressed RAW would be amazing. I use it on my DSLRs for photos all the time and see little to no loss in detail. So I hope CD can pull it off and muster up a compression option for all their RAW footage.

Isn't compressed RAW the reason why Sony is getting sued by RED? Of course I would love to have compressed RAW, though.
 
Ted, at the time we couldn't edit the MXF files native or else I would have. I edited Sony F55's XAVC right in Premiere on another film, no problemo. I was on the edge of my seat waiting for Adobe to release that October 2013 update to only find out MXF wasn't supported at all in the "Direct Link" feature to Speedgrade. What I did was graded the DPX files individually and then created LOOKs to be applied later in Premiere. It worked out well.

I think compressed RAW would be amazing. I use it on my DSLRs for photos all the time and see little to no loss in detail. So I hope CD can pull it off and muster up a compression option for all their RAW footage.

Adobe's DNG Compressor offers a variety of compression, but, they're all lossy...so what's da point if I have 12-bit 422 HD?
 
Adobe's DNG Compressor offers a variety of compression, but, they're all lossy...so what's da point if I have 12-bit 422 HD?

I was under the impression that Cinema DNG supports uncompressed, lossless, and lossy. I don't know of any cameras supporting lossy, but the BMPCC uses lossless dng raw I believe (in practice only about 1.3x compression, though).
 
Noah,

Yeah, I might be wrong. I was just looking at what Adobe has on their website.....they call it lossy.
 
Ted, at the time we couldn't edit the MXF files native or else I would have. I edited Sony F55's XAVC right in Premiere on another film, no problemo. I was on the edge of my seat waiting for Adobe to release that October 2013 update to only find out MXF wasn't supported at all in the "Direct Link" feature to Speedgrade. What I did was graded the DPX files individually and then created LOOKs to be applied later in Premiere. It worked out well.

I think compressed RAW would be amazing. I use it on my DSLRs for photos all the time and see little to no loss in detail. So I hope CD can pull it off and muster up a compression option for all their RAW footage.

Oh I understand Chris, I went through the same process you did waiting. In the end I had to wait on music composition and eventually sound design long enough that I was able to rationalize putting off the .mxf grading issue until Adobe finally made the files work. Sorry you didn't have the time to wait for it, but it sounds like you got it sorted out pretty well, anyway!
 
thanks! I will give it a try!


edit
first test looks great. I see no difference in compressed DNG, also it's handled fast by Resolve. File size shrinks from 3.4 MB to 1.2 to 2.4 MB
Great improvement. Thanks for this tip (note to myself: don't forget the audio file)
 
Last edited:
Check adobes dng converter:
http://www.adobe.com/support/downloads/detail.jsp?ftpID=5695&promoid=DTEHQ

you can compress lossless dng (zip-like) which reduces a 11.3MB (4K DNG) to a 4.5 - 7MB frame (content-based).
Even lossy compressed dng is possible but only the lossless variant is supported by DaVinci Resolve (at the moment) and its pretty fast (thanks to zip) so you can keep the same great workflow and flexibility.

Whodathunkit? I thought the DNG converter was for stills only. But, lo and behold it works with still sequences. I see a slight color shift on the compressed files, but, nothing that isn't overcome in resolve.

Thanx McReedy
 
Back
Top