Picture Perfect: a 1080p24 D90 - the noiseless, the stepless and the bandless

beckspace

Active member
Before reading, start downloading the 85mb output file to view it later -----> (1920x1080 24p Mpeg4)


I was testing the step removal from Lee and it worked splendidly, fantastic work

It was so good that I need to contribute too

The step removal project was finished by Matthew, another great work but his solution to overcome the D90 noise/artifacts is to downsample the image, apply instantHD and noise to moisture the banding

The problem with it is the clean/crisp parts of the image get noisy and instantHD can make the color banding even worse



Instead of downsampling and losing information, there is a software called Neat Video, an amazing algorithm developed for JPEG artifacts/noise removal in images that now works inter-frame in video

The process for the (almost) perfect picture:

33dvbqh.png


Its a bit of rocket science; you'll need to set Neat Video first: shoot an uniform surface with the D90 and it must be NOT well lit (you need its noise now more than anything else). once this information is accepted by the program, it is ready to erase all of its patterns of noise and artifacts of the movie

I used the default settings and already had a noiseless image at the first trial. There are countless adjustments to be make in Neat Video... it needs research because I got some aliasing issues

Now that I had a noiseless image, I could finally use Instant HD to blow-up the image to 1920x1080 (instantHD only truly works with a noiseless imagery)



Just to be clear of how this process was:

1) Replaced the movie in the AE stair step removal template (matthew's version) and rendered it (lagarith codec) --always render, AE gets crazy with third-party plugins

2) Shot the uniform surface with noise and applied Neat Video (rendered it again)

3) Then, applied InstantHD:
created a new composition at 1920x1080 (square pixels) and the same on
InstantHD's custom size.

that's it.

Noiseless, artifactless, stepless and bandless.

I have some doubts that this process will work so well with the 5D because of the H.264 block-oriented compression; the D90 is intraframe MJPEG, its artifacts create a pattern easily recognized in each static frame. The H.264 interframe artifacts doesnt create a pattern, it changes accordingly with the motion of image captured. Probably Neat Video will blur the 5D more than a reconstruction of the lost information. But Neat Video would work like it does with D90 with any other intraframe codec in the market, film included



This D90 test was shot with a 40w home lamp (you can see it in the lens reflection) at 3200 ASA--I think it was-- at 2.8 aperture using Kholl's technique. Original untouched file directly from the memory card -----------> 34Mb

I shot this with a 15 years old 50mm nikkor manual macro lens (it has some fungus, the image has a soft light blurred all around)

The banding you see in the 85mb file is consequence of the compression and also it flats the darker areas, so I took some PNG shots of the 1080 final composite in AE CS3:

example #1

example #2

example #3

example #4

And it can be still improved with tweaks in Neat Video.

Noise is for the weak, like HDR photographs


------------------------------------------------------

SKIN TEST

I did it to see if Neat Video artifacts could make a 'plastic' skin, blur details or create strange aberrations.

Still didn't found an AE plugin to fix my face, so sorry about that

I put them side by side, noise vs without noise, on the exactly the same settings used above ------------> (720p Mp4 81Mb)

Also shot it with an well exposed face and then a low-light sub-exposed face

PNG example #1

PNG example #2 (low-light)

I also didn't test the inter-frame noise reduction yet on Neat Video; this is a second step, I think it could blur the image but I see that sometimes it may be needed (look at the background)


my hand at 1080p --------> 45Mb

quicktime is not very suitable to watch 1920x1080 mp4,
VLC or Media Classic are better

----------------------------------------

FLOWERS TEST

Soon
 
Last edited:
Wow ! Pretty impressive, the 1080p really does stand up to scrutiny ! Good stuff !

Looking at the RGB channels helps to illustrate the efficacy of 'Neat Video'.

rgbkv9.jpg
 
It'd be nice to see these techniques used on Skin, outdoors, indoors etc. Camera must return.
 
bravo!

i can still see a little midtone noise at 9 seconds in
but apart from that it looks fantastic!

neat video works with (free) virtualdub as well, for a $100 denoising solution...

beckspace, can you upload the original clip as well so we can compare?
 
Thank you for this. The plugin is very affordable but unfortunately for Windows users only:
http://www.neatvideo.com/

Yeah, spotted that :(

You can get pretty close to this kind of improvement by simply applying an adjustment layer in After Effects - setting it's transfer mode to 'color' and applying a filter such as Lens Blur to that adjustment layer (Median also works well to remove compression artefacts).
 
Okay, but with all this information, how hard it is for someone to write, let's say a D90 AE plugin that does all this work?
 
I can ask my friend Peder from trapcode, He hires a desk in my office.
He has written some of the best ae-plugs ever.
 
Okay, but with all this information, how hard it is for someone to write, let's say a D90 AE plugin that does all this work?

The LEEFIX part shouldn't be hard. Cut each frame into 82 slices and rebuild 810 pixel tall frames with interpolated ( (p1+p2)/2 ) 1px lines in between. The slices are here:
http://www.dvxuser.com/V6/showpost.php?p=1433751&postcount=37
I wished I where smart enough to write AE plugins. It only makes sense if it speeds up the process of course.
 
Last edited:
Do you know how do we change the time of the composition to extend the replaced clip lenght? im only rendering 168 frames hehe

i know its not hard but its freakin' me out. i can change the composition but the clip wont grown longer
 
Where's your camera, Kholi, not in the repair shop I hope...

I hate to say it, but the real usability test (as stated above) is a portrait, in which the face is not rendered plasticky, and then of course the dreaded 'fine detail outdoor view with a fine off-horizontal fence or british bus in the background'.

But, so far, for mechanical stuff/still lifes, etc.. this technique is great!

Looking forward to the true torture tests!
 
Where's your camera, Kholi, not in the repair shop I hope...

I hate to say it, but the real usability test (as stated above) is a portrait, in which the face is not rendered plasticky, and then of course the dreaded 'fine detail outdoor view with a fine off-horizontal fence or british bus in the background'.

But, so far, for mechanical stuff/still lifes, etc.. this technique is great!

Looking forward to the true torture tests!

+ The Obligatory Flowers Test! :-)
 
Do you know how do we change the time of the composition to extend the replaced clip lenght? im only rendering 168 frames hehe

i know its not hard but its freakin' me out. i can change the composition but the clip wont grown longer


First you need to change the length of the composition to whatever you want.

Then pull all the pieces of footage out to that length.

This needs to be done to all the compositions in the project window (I don't quite know how Matthew set this up as I only have an old copy of AE and cannot open his file).


. . . . . . . . . . .


To extend the composition - hit (mac) command K and change the composition length.

Then you can drag out the footage.
 
Back
Top