jello removal using deshaker

M

mattsand

Veteran
hi,

i've found that while deshaker doesn't quite work as a jello remover when the camera is shaking a lot, i don't think any software solution does, it works great to "silence" semi steady handheld shots that otherwise get a floaty feel due to the slight jello. i leave the actual stabilizing on zero, rolling shutter percentage at 98%, apply no scaling and choose to fill in the blanks from previous frames. here's an example (processed to the right):

http://www.mattias.nu/stuff/unroll.mov

i love it, and will most likely use it on at least a dozen shots for my feature. the rest is either already super stable (steadicam rig or tripod) or simply beyond repair.
 
so everybody loves to talk about how bad jello is but when it's removed it's not interesting anymore? bumpy bumpy.
 
He's Looks like it works a treat on the footage you put up of the jesper guy, it's exactly that 'floaty' feel that i want to get rid of. Downloaded it. My next project on PC i should to open an avisynth script (for destepping) and add the deshaker filter and output with picvideo codec, I guess that's a correct way to do it? Thanks
 
Last edited:
It looks good mattsand. How useful do you think this approach is when your subject is moving quickly? How do you handle camera movement vs. subject movement in this case with deshaker?
 
deshaker picks up the most dominant motion of the frame, so in the case of a moving closup it would remove the jello from the subject and increase it on the background. i'm testing this very thing right now. if the subject is moving quickly over an otherwise static frame the filter will do nothing. which is nice, i'm not really a fan of per subject corrections a la the foundry or twixtor, because as stu maschwitz put it an image that's 100% made up of computer generated pixels that's never exactly what was really there doesn't feel very good. deshaker just skews and scales the image, it doesn't generate any pixels (except at the edges) nor does it move them in respect to their neighbors.
 
pveal said:
i should to open an avisynth script (for destepping) and add the deshaker filter and output with picvideo codec
Click to expand...
that's exactly what i do, and it opens up fine back in fcp. huffyuv wold be an alternative since it's lossless and works fine on the mac using perian, and picvideo already does its deblocking magic on opening the file, but i haven't seen any difference in quality to be honest, just much bigger files.
 
Can you post a short video update when you've gone through your current trials? It would be appreciated. This looks like a solid answer. I got excited when I heard about the foundry, but I couldn't come at the foundry solution for the very reason that what you photographed wasn't there.
 
here's an example. notice how the jello of his face is almost completely removed, but how the rest of the image gets more jello instead, especially when he turns his head towards the end. it's all a matter of preference i guess. you could probably decrease the percentage of roll in deshaker and get a "half" correction for problematic shots.

http://www.mattias.nu/stuff/unroll_cu.mov
 
oh, and since there's no real motion of the frame there's no data for deshaker to generate new border pixels from, hence the black. you could use the extend pixels option i guess.
 
Yeah, it's starting to look like a real editing tool, rather than just a correction tool. Setting a jello "balance" - your half correction suggestion - sounds fine - there is of course plenty of "balanced" blurring and other movement in motion film frames. Jello must also have its own aesthetic.
 
yeah i don't dislike jello as long as it feels organic, the fact that trees lean when you pan past them is fine, and that a person's face wobbles when they turn their heads too. my problem is just when the frame becomes unsteady, which brings attention to the camera and takes the viewer out of the story. but just like lens flares for example, which aren't there in real life either, that could also bring a kind of aesthetic that could work for some shots.
 
So in you last footage you had jello because your actor was moving his head too fast or cameraman screwed steady shot and moved camera ?
Idont see that much jello on this footage (left is original ?) ,corrected version looks weird sometimes like its floating,i have deshaker too ,it can fix some steadicam shots but im not sure about nikon jello problem.
 
bwwd said:
So in you last footage you had jello because your actor was moving his head too fast or cameraman screwed steady shot and moved camera?
Click to expand...
just look at the footage. in the original the background looks fine while his head wobbles as he moves, when i correct for that wobble the background obviously starts to wobble instead. it was meant as an illustration of the problem with the deshaker approach. btw you don't have to "screw" a shot to get jello, the normal freedom of movement you're typically after when shooting handheld is enough to get that floaty look, which sometimes works, sometimes not.

yes, deshaker is pc only, works perfectly in vmware and such though, that's how i run it. i have a couple of pc's but they all run mac os. :-)
 
bwwd said:
i have deshaker too ,it can fix some steadicam shots but im not sure about nikon jello problem.
Click to expand...
i don't use the stabilization at all, just the built in rolling shutter correction. set the amounts to 0 and it will correct the jello without stabilizing. do you have the latest version? the rolling shutter code is new.
 
any movement will cause jello, i just find that "subject jello" is more acceptable than general jello of the entire frame.
 
You must log in or register to reply here.
Back
Top