The Great Chroma Key Smackdown

Barry_Green

Moderator
Okay, I looked and looked for where to put this, and I can't find anyplace that's logical for it, so... it'll go here unless someone suggests a better home.

I've seen questions about chroma keying with the new cameras, and how they compare to the older generation, etc. I've seen people keying a bald guy on an SLR and saying "hey, it keys great!" Er... not exactly a rigorous test, y'know?

So I decided to make a hellacious torture test for keying, and shoot it on a bunch of different cameras, and post the camera-original raw footage so you guys can try keying this stuff.

It's nasty. Some white lacey fabric and some red lacey fabric (what the heck is a "vault"? I dunno, but these fabrics called themselves "vaults" and they were $2 each at the fabric store.) Anyway, those lacey fabrics up against a green screen, and being blown around by a hair dryer. A red-haired woman, holding a cat, and her hair being blown around by another hair dryer. She's wearing a fuzzy-ish sweater, with a lace-ish scarf and a weird super-colorful scarf-ish thing. It's pretty much the worst-case scenario for keying you'll likely run into. I wish I would have had her holding a glass of water so you could try keying through that too, but I didn't think of it.
Chroma-Key-Smackdown-Still.jpg






The contenders:

7D
GH1
HMC150
HMC40
HPX170

The camera-original footage is here: http://www.mediafire.com/download.php?nkmimwteckn
Be aware that it's about 124 megabytes. Each camera's clip is pretty short, only a few seconds. I wanted you guys to have motion footage and not just a lame still-frame, because the effectiveness of your keying is revealed in the motion.

Now, PLEASE HEAR THIS:
I didn't attempt to match the cameras to look the same; I just set them all to mild default settings, flat gammas with lower detail levels. Cine-D on the AG-cams, "neutral" on the 7D, "smooth" on the GH1. And I tried to get a proper white balance with each. With that said, they don't look the same. I wasn't trying to make them look the same. I didn't try to equalize out the color saturation or the toe or knee or anything. If you need them to look the same, that's another whole rigamarole, which is a lot of hassle and I didn't feel like doing it. :P So, it is what it is. It should still be a valid test anyway.

Second: If you want to use the GH1 or HPX170 footage, YOU WILL HAVE TO STRIP OUT THE PULLDOWN. HPX170 was 1080/24pA, so pull out the advanced pulldown. GH1 has, of course, 2:3 pulldown in its 1080/60i data stream. If I see *anyone* posting clips with interlaced lines in 'em, I'm going to have to ban them for not reading. :D

Third: When working with the GH1 footage, you MUST use a pulldown-removal method that properly restores the chroma. Cineform NeoScene does so; I don't know what else does, but if you don't restore the chroma properly you'll be severely and unfairly handicapping the GH1 by throwing away half its chroma information.

All the footage is stored in complete folder directories as from the cards, so any editor that pukes without the full directory structure (and by that, I mean FCP) should be able to work with the files.

Feel free to garbage-matte the edges, some of the cams might be showing the edge of a door frame or the edge of a light fixture, so a garbage matte is a perfectly acceptable technique.

So -- here you go. If you can pull a successful key from any of these, you're better at it than I am. But if any skilled keyer would please take the time to pull the very best they can from this footage, from each camera, that would be awesome: it would be illustrative for us to see what you can get out of these cameras and how they stack up against each other.

More boring details: all five cameras were set up at once, all pointing at the same scene, using a preposterous combination of tripods, 1/4-20 to hot-shoe adapters, light stands as tripods, etc. They were all a long way from the scene and zoomed in, trying to minimize the parallax and get at least a reasonable approximation of the same direction of lighting on the subjects. I made an effort to make the relative magnification all approximately the same; the successfulness of that venture is for you to decide. The SLRs were at f/5.6 on their stock lenses, and I had to go to ISO 640 to get the appropriate brightness out of them. Exposure was set by piping the signal out to my BT-LH80 and using its waveform monitor. All sorts of user error could have crept in at all sorts of places, it's incredibly difficult to coordinate five different cameras and even remember how they all work, much less get every detail exactly right. I just hope they're at least in focus. If they're in focus with a decent white balance, I'll chalk that up as a "win." All cameras were set to 1080/24, all had detail turned down a couple of notches from default, except for the 7D which had the "neutral" profile which defaults to detail being zero anyway. If you want to add sharpening after the fact, go ahead. Light was such that the HMC150/HPX170 were at f/4 and 0dB of gain. The HMC40, unfortunately, had to have 6dB of gain on it; it just wasn't sensitive enough to go with zero. That's a big disadvantage for it, so if it manages to come out of this in any way respectably, it should only get better when lit appropriately for 0dB. Don't ask for me to test more cameras; if you didn't see it represented here, it's because I don't have one.
 
Last edited:
Thanks Barry, I am gonna have some fun with this! I don't have much in the way of powerful key tools but I know some are out there that I am sure people have...at Macworld 2008 I watched some guys have perfectly keyed footage of me pouring water from one cup to another in real time...
 
ha ha that is so awesome. yeah a glass of water would have been a perfect touch. also some shadows!!!

I don't think my keying skills are up to par for this challenge but i'm looking forward to seeing the results! good luck everyone!
 
Just did the HMC-150, doing the others now...I'm not great at this but this footage isn't too bad...will post to vimeo when all done. Here is a screen grab...background is still photo to cut down on render times.

The sides got keyed out a bit but that's easily fixable with a mask...the hair dryer I'll have to work on a bit it's getting keyed out, I know the still doesn't show much and it's just the HMC right now but the hair, scarves, etc, keyed pretty well...will post final results from all of them soon..

screenshot20091111at122.png


EDIT:
I'm heading to bed...so far the HMC-150 was the easiest, the GH1 footage has some weird red shift when I tweak my settings to get it keyed properly...but I am noticing some weird interlacing pattern despite the fact that I removed the pulldown...hmmm... The 7D seems to be having trouble keying the sweater (goes translucent) will post more soon...
 
Last edited:
Barry:
I was just glad to read you had to buy the red and white frilly lacey thingies and didn't already own them yourself....
Ben: That key looks pretty good!
 
The problem with this test is the model isn't wearing the "vaults". ;)

Thanks again for your continued efforts and for sharing. :thumbsup:
 
Thank you barry, I tried all of them and I must say that the hpx and hmc are the best ones, thought you can feel a difference between the edges of both, the hpx having better edges. You can note the edges jagging in the hmc40. Otherwise the dslrs are nice and have the same quality as the hmc and hpx though I needed more time to get the same results.
 
Ben, with the GH1, make sure the way you're removing the pulldown restores the 4:2:0 chroma properly. If you don't, you'll get that stairsteppy nonsense and have no shot at really keying well. That's a big downfall of that stupid embedded-in-60i thing.

Your HMC150 key looks absolutely fantastic! How does it look in motion?

ilauzirika, I'd never seen that in your signature before, but that "Panasonic HMC151 #302" is pretty hilarious.
 
ilauzirika, I'd never seen that in your signature before, but that "Panasonic HMC151 #302" is pretty hilarious.

hahaha I said, what the heck, everyone has a red number! why not a hmc number and I just wrote it down( last year around this time).
 
Hi! I did 7D chroma test. Here are the results:

I used AfterEffects with KeyLight. I'm not a chroma expert. I tried to keep it simple: a few tweaks within the plug-in, that's all. I'm sure if someone tried harder (and had more knowledge in this field) there are some possibilities there. I had some problems with straight lines (like the black pole) and with the sweater. Also the red fan (?) behind was problematic - lot's of visible pixels on the edges...
 


HMC-150 footage...I tweaked the privacy settings so it's only viewable on DVXuser..if you can't see it let me know.
 
I used Keylight in after effects after first doing most of the coarse work with basic color keys, which really cuts down on the render times and allows you more precise control over what you're doing with Keylight.
 
You guys are doing amazing. I never would have expected such good results. I'll have to try harder next time! :)

Anybody tackled the HPX170 yet? Does the 4:2:2 make it easier?
 
You guys are doing amazing. I never would have expected such good results. I'll have to try harder next time! :)

Anybody tackled the HPX170 yet? Does the 4:2:2 make it easier?

Thanks Barry.

Yeah I was playing around with it but am having a bit of trouble with the hair... but I am gonna try again after converting it to ProRes instead of DVCProHD...that's given me better luck in the past. I've been increasing my color space in after effects to 16 bit from 8....I am not big on the technical details with this stuff...I just fiddle with the settings until it matches the original when I put it back in my timeline (but sometimes for keying these things the colors get shifted a bit just as part of keying it with keylight..)
 
Back
Top