Amazing New Green Screen Research

[Ralph B]

Here's a research paper on a new and superior greenscreen process.

http://people.inf.ethz.ch/~aksoyy/papers/TOG16-keying.pdf

Can't wait for this to become available commercially.

 

[Jim Ritscher]

This looks a little too dense for casual reading. Would someone be kind enough to summarize the core idea?

 

[paulcurtis]

It's an approach to keying footage by 'unmixing colours', it is very dense but offers an interesting methodology. I spoke to the guy that wrote it, and once it gets published officially there will be some sample videos.

I suspect only the hardcore vfx folk around here, if there are any, would truly appreciate the approach though. Anyone that's spent hours faffing despill maps and dealing with hair would perk up but long term if it works as shown then a commercialised version could end up in various applications.

cheers
Paul

 

[DPStewart]

For sure!
I spend way too much of my time faffing despill maps as it is.

(I have NO IDEA what the heck that means!)

 

[David W. Jones]

Roughly translated..... Our keying is dope! rogar-BigGrin(DBG)

 

[firehawk]

Keying help is welcome on my street for sure

 

[Jim Ritscher]

Thank you for the summary.

 

[Ralph B]

I spoke to the guy that wrote it, and once it gets published officially there will be some sample videos.

Did he give you any more information?

 

[paulcurtis]

Did he give you any more information?

There's a full paper that will be published, along with higher res examples and videos. There's a nuke plug in but it's not commercial or available.

It appears to focus mostly on producing better despill maps really. So when you're extracting fine detail from semi transparent green then they can reconstruct what the colour bleeds too, based on this energy conversation idea. The vast majority of real keying is dealing with those fine edges, if you key off a mid grey luma green onto a very bright or dark background then the edges of your key will be antialiasing to a totally different luma than you need. So preparation of a despill map is important in treating the background so that it is closer to what you'll be keying onto.

As any one that does any real green screen work will attest, that's a f&*%$king nightmare most of the time. I always find it amusing in breakdowns when you see the wipe and it's oh look they eroded the hell out of that edge. Or when edges move from background over green and they change. See it a lot in lots of movies.

cheers
Paul

 

[Thomas Smet]

There's a full paper that will be published, along with higher res examples and videos. There's a nuke plug in but it's not commercial or available.

It appears to focus mostly on producing better despill maps really. So when you're extracting fine detail from semi transparent green then they can reconstruct what the colour bleeds too, based on this energy conversation idea. The vast majority of real keying is dealing with those fine edges, if you key off a mid grey luma green onto a very bright or dark background then the edges of your key will be antialiasing to a totally different luma than you need. So preparation of a despill map is important in treating the background so that it is closer to what you'll be keying onto.

As any one that does any real green screen work will attest, that's a f&*%$king nightmare most of the time. I always find it amusing in breakdowns when you see the wipe and it's oh look they eroded the hell out of that edge. Or when edges move from background over green and they change. See it a lot in lots of movies.

cheers
Paul

Word