Tested the Atomos Ninja and FS100

Richard Allen Crook

Well-known member
I had the chance to try out the Atomos Ninja with the Sony NEX FS-100. It seems the jury is out as to whether adding the near $1000 device to the camera kit is worth the purchase or not. There are three areas I wanted to test with the FS100:

1. Is recording to the less-compressed Prores 4:2:2 look better or worse than the AVCHD in terms of overall picture quality, judging:
a. Compression artifacting?
b. Noise Level?
c. Aliasing?​
2. Is recording to the less-compressed Prores 4:2:2 improve results when post color grading?
3. Is recording to the less-compressed Prores 4:2:2 improve the ability to chroma-key in post?

View attachment 44248

RESULTS:

OVERALL PICTURE QUALITY.
It seems there is no difference in compression artifacting, INCLUDING when there is high movement or quick pans…which is where you usually see this phenomena. Obviously you can’t see the result of movement in the photos below but believe me, I whipped the camera around all over and it’s amazing how well the AVCHD held up. I couldn’t see any difference at all whatsoever. Now there is a noticeable difference in the noise level, but surprisingly not in Prores’ favor. The noise amount appears to be the same, but the noise structure in the Prores version seem larger and more like video noise than the AVCHD which is smaller and more grain-like. Aliasing is a HUGE issue for the Prores version, as you can see in the photo with the phone lines through the sky. This is after pulldown removal and deinterlacing…that is all aliasing folks! Horrible aliasing in fact. The AVCHD looks obviously better and doesn’t contain one bit of aliasing at all.

COLOR GRADING.
I dropped equal “fast color corrector” settings on each clip, mainly pushing the contrast way past acceptable levels to really see what happens to each image. This SHOULD bring out the worst in any 8bit codec an this should be no different. As seen below in the images, there is no banding in the gradients on the walls nor sky (sorry my sensor was very dirty…I cleaned it right after this test!). If this was DLSR footage there would be horrible banding occuring so this is a great testament to the AVCHD coded and Prores alike…but unfortunately there is no additional benefit to Prores in this test as they both equally handle contrast equally.

CHROMA KEY.
I did a simple chroma key on a greenscreen using something I think would pose issues…a poinsetta with red and green leaves. Even the foil wrap is green. I pulled it into Premiere and applied the EXACT same settings using ultrakey and both keyed perfectly fine with no difference at all. Even as I blow it up 500% and look at the edges and detail, I can see where the foil got keyed out in the shiny parts in the Prores file but it’s very very minuscule and could be easily adjusted using the settings in the ultrakeyer but I wanted to keep the setting exactly the same to show how close the two clips are as far as how easy it is to key.

---------------------------------------------------------------

FINAL THOUGHTS:
I really really really REALLY wanted the Ninja, and more importantly the Prores less-uncompressed codec, to hold up better in terms of the criteria I outlined above. But in every way, the AVCHD held up much better if not the same. I will say, however, that the Prores seems to play nicer with Premiere, but that’s another topic for another time! All in all, I will probably be returning The Ninja. It may very well be great for other cameras or applications, but I don’t feel in my opinion that it improves footage from the FS100…in fact I believe it does the opposite.

CLICK HERE for the screengrab .tif files so you can see a non-compressed image. Warning: these files are very big. Each files is marked as “Shot A, B, C” and the codec is marked “AVCHD or PRORES.” There are also the two chromakeyed screengrabs comparing the two codecs.
 
Last edited:
This is after pulldown removal and deinterlacing
Why would you de-interlace? That right there would create all manner of stairsteppiness. You should never de-interlace progressive footage, ever.
 
Oh believe me if I could record progressive on the Ninja...I would, haha. Unfortunately it does not support 50/60p recording, therefore you must set the FS100 to output 1080i/576i, 50/60i. This is what is being recorded...even though 24p or 30p is embedded in that signal. This page on the Atomos website explains that better than me though: http://atomos.activehosted.com/kb/article/ninja/ninja-with-fs100

Barry, do you have any suggestions how to do proper pulldown removal of 23.97 footage embedded into a 1080i 60i stream using Premiere? Perhaps I THOUGHT I did the pulldown removal properly, when the aliasing is in fact the interlacing acting all whacky?
 
Yes why deinterlace.

And heres a test with the Af100. I can clearly see a difference.

http://vimeo.com/25060362

Different camera, different results. Also that is comparing AVCHD footage converted to Prores vs Ninja Prores being recorded directly from the HDMI. Do you have footage comparing the Fs100 to Ninja? Would love to see what others have come up with. My tests show a different outcome that...at least for the FS100...that the ninja doesn't do anything better for the workflow. :)
 
Last edited:
Crap, it appears I messed up something with the interlacing. Had some trouble with the Premiere learning curve on removing pulldown. The stair-steppiness was definately an interlacing thing...which I fixed and the stairs went away. Few...I was really scared that it was the codec. Anyway...I updated my post! Now that the aliasing problem isn't there anymore, what I can take away from this test is that there really isn't much difference. And again I am comparing the Ninja footage to the NATIVE avchd file...in other words I didn't transcode anything before pulling these into Premiere. I guess if you're a FCP editor it might be better to use the Ninja files over the transcoded AVCHD files. (Transcoding...yuck!) :)
 
My bad. Thought that might help you richard. Maybe get closer to a solution for you. Maybe show you that the ninja is actually doing what its supposed to do for at least the Af100. In the future I'll learn to resist that temptation.
 
Oh believe me if I could record progressive on the Ninja...I would, haha. Unfortunately it does not support 50/60p recording, therefore you must set the FS100 to output 1080i/576i, 50/60i. This is what is being recorded...even though 24p or 30p is embedded in that signal. This page on the Atomos website explains that better than me though: http://atomos.activehosted.com/kb/article/ninja/ninja-with-fs100

Barry, do you have any suggestions how to do proper pulldown removal of 23.97 footage embedded into a 1080i 60i stream using Premiere? Perhaps I THOUGHT I did the pulldown removal properly, when the aliasing is in fact the interlacing acting all whacky?
I am certain that properly processed footage should show no more aliasing than the native recording. So yeah, I would suspect that there's something wacky happening in the processing.

Shouldn't you just bring in the footage as-is in its 60i wrapper, and then tell Premiere to interpret the footage to remove 3:2 pulldown? But definitely, under no circumstances should you be de-interlacing.
 
Crap, it appears I messed up something with the interlacing. Had some trouble with the Premiere learning curve on removing pulldown. The stair-steppiness was definately an interlacing thing...which I fixed and the stairs went away. Few...I was really scared that it was the codec. Anyway...I updated my post! Now that the aliasing problem isn't there anymore, what I can take away from this test is that there really isn't much difference. And again I am comparing the Ninja footage to the NATIVE avchd file...in other words I didn't transcode anything before pulling these into Premiere. I guess if you're a FCP editor it might be better to use the Ninja files over the transcoded AVCHD files. (Transcoding...yuck!) :)
Glad to hear that's sorted out.

I've been telling people for a while that AVCHD is surprisingly good, and that so many people who think that they "need" an external recorder... probably don't. Back when the AF100 was almost to market, there were tons and tons of posts about external recorders, and I was always saying "hey, just TRY the native codec first, you might be really pleasantly surprised..." Now you don't hear that much talk of external recorders anymore...

External recorders offer redundancy (which is a great thing) and they offer files that are more FCP-ready (not a big deal for Windows folks though, AVCHD is about as editable on Windows as ProRes is). And they offer 4:2:2 color sampling, which can make a difference; really surprised that you didn't see more of a difference in your keying. But the FS100 and AF100 both don't offer 10-bit, so that aspect of an external recorder would go completely unnoticed.

I think an external recorder for an F3 is pretty much mandatory, but on an FS100 or AF100 I don't think it's nearly so important.
 
My bad. Thought that might help you richard. Maybe get closer to a solution for you. Maybe show you that the ninja is actually doing what its supposed to do for at least the Af100. In the future I'll learn to resist that temptation.

I didn't really mean to be snarky. Sorry if I came across that way.
 
I definitely like the noise in the AVCHD better, and this is something I noticed on AF100 footage as well when using an external recorder. (I had an AF100, now I have an FS100). I've just not seen anything off of either the FS/AF 100 from both internal and external recordings that has convinced me to purchase a recorder. Thanks for sharing your tests because they confirm what I've seen as well.

I agree with Barry, I think AVCHD is actually amazingly good for the bit rate.
 
And they offer 4:2:2 color sampling, which can make a difference; really surprised that you didn't see more of a difference in your keying.

Surprised me as well. I'm still doing more testing...I'm going to try to shoot an imperfect greenscreen next. Really push the keyer to get something out of an improperly lit greenscreen and see if the 4:2:2 makes it easier.

Also I was sold on your thoughts about the AVCHD codec earlier in the year at NAB and seeing your comments about it here...which is one of the reasons I got the FS100 in June! :)
 
Finally a confirmed answer for me in regards to
an external recorder. I suppose it will be considered
a redundant system for me at some point.

Thanks for the time invested Richard.
 
although i can't speak to using the ninja at all, i did do an artifact test by recording to the sd card and hdmi direct into final cut via my blackmagic card at the same time. ingested as prores 422HQ. most everything i shot looked identical for the most part. the big difference is when i waved my hand in front of the lens. the avchd did it's best to make sense of it and did a decent job but the result was banding and blocky artifacts. the prores version displayed nice smooth motion blur. that test deterred me from buying an external recorder because the difference, while noticable, was still very small. not enough to warrant $1000 and extra crap to hook up. if the ninja removed pulldown internally, i would get it just for convenience.

at that point, i had no plans to ever shoot greenscreen with the fs100. i would use my ex1 instead. but then i sold the ex1 and did my first greenscreen shoot with the fs100 a month ago. it wasn't horrible but it wasn't on par with the xdcam ex codec. i think i may lug my mac to my next greenscreen shoot and go direct into fcp to see if that helps.
 
Over on the Pro Video Coalition, they have a pretty good description of benign and malignant PsF and how to decode it. The FS100 is termed rather malignant. When importing this footage into After Effects, it is incorrectly labeled as interlaced. One must go into "Interpret Footage" and manually reset it to Progressive. If one does not do this, it gets horribly stairstepped.
 
YOur images show that the prores does in fact hold up better for keying.. but not much. I feel like I would just stick with AVCHD.. or record HDMI uncompressed into my mac pro If it was really critical.
 
I did thorough tests with high detail plus high motion scenes, like leaves, grass, water, all backlit. External recording is way better in such situations. For anything else, it's difficult to see the difference.
 
What I noticed examining fs100 AVCHD vs Ninja Prores footage posted in dvxuser forums,
that AVCHD, like any other high compressed format, merges similar pixels, and if we add contrast to those areas, then difference becomes noticable.
difference area:
http://vaizdostudija.com/dideli/4AVCHD_PRORES_HQ (0;00;00;00).tif
http://vaizdostudija.com/dideli/4AVCHD_PRORES_HQ (0;00;00;00).tif
whole pictures:
http://vaizdostudija.com/dideli/4ATOMOS_PRORES_HQ.png
http://vaizdostudija.com/dideli/4AVCHD_PRORES_HQ.png

I've done a lot of green screen work with compressed and a lot with uncompressed hdmi recording. If subject is standing still, there is no difference. Difference becomes noticable when subject moves, and there's some motion blur, in blurred out of focus areas, in shadows on green screen, in hair and in transparent objects. It would be great to see how fs100+ninja performs in those situations.
 
It would be possible to test fs100 green screen with moving subject, blurred out of focus areas, shadow on green screen, waving hair and transparent objects?

someone?
 
Having played with the Ninja in PAL-land, its 25psf is absolutely fine, no resolution loss, it's basically just 25p. This was NOT what happened with the KiPro, which defaults to 50i all the time despite pleading with it in its menus to do progressive. Just sayin'.

OTOH, I'm still up for some more chromakey testing. We're all now pretty used to using 'Hybrid' chromakeyers that tend to look at luminance to work out detail on top of the general chroma key. This is all fine and dandy right up until the point you want to do keyed motion tracks using coloured markers. These help your software resolve the camera position and movement, so it's not just the key. This is where 4:2:2 (and preferably 4:4:4) material wins over native footage.

One final thumbs-up for Ninja is for those of us who do long-form recording (for my sins, I also do a lot of conferences). With 6-8 hours of material per day per camera (often a 3 camera shoot), that's a lot of transcoding. If you're doing periodic updates on events, the joy of whipping out the disk, whacking a new one in, then taking the morning session straight to FCP and hacking out 5 minutes of sound bites in the lunch break is a joy - though I miss the compactness of XDCAM-EX (35mbits per second, editing natively in FCP7 using Calibrated-Q plugin).

Plus the 100-200% hike in hard disk prices hurts a codec choice between 35mbits and 150 mbits per second. ;-)
 
Back
Top