the whole 4:2:2 thing - to David Heath

Hi. I actually contact David Heath regarding this thread. I don't know if he has a user account but he has written to me and has given me permission to quote his emails.

Here they are:


email 1

"As far as the DVXuser posts in that thread go, then a couple of points. The whole 4:x:x notation should really be only used in relation to a RECORDING system, and it starts to get very messy when it gets used more widely. The important essence is that it denotes the ratio of recorded colour samples to luminance samples, just as the article that David Jimerson posted to in that thread says. What’s important in this context is what happens in the vertical direction, and that thread is assuming 1080 video, so we’ll consider a vertical line of 1080 pixels.

In this case, 4:2:2 implies that 1080 luminance and 1080 chrominance samples will be recorded vertically, 4:2:0 implies that 1080 luminance and 540 chrominance samples will be recorded. The numbers say NOTHING about what the front end of the camera is generating. The assumption in the DVXuser article is that the head output has equal luminance/chrominance resolution, and for a non-pixel shift 3 CCD camera that’s true. But cameras with Bayer sensors, or those using pixel shift, have a luminance resolution that is inherently greater than the chrominance resolution. I stress there is nothing wrong with that. It matches the human eye, which is inherently more sensitive to changes in brightness than in hue, and is the whole reason why colour subsampling is used in broadcasting.

In the case of the 200/171/151, there are 540 r,g,b pixels each vertically, so at first sight the luminance and chrominance resolutions may be thought to be 540 (lens permitting). In practice, the r and b pixels are offset from the g to enhance the luminance resolution (by a factor of about 1.5X overall, and because the camera uses 2 dimensional shift, it’s about sq root 1.5 on each axis, say 1.25x) but this doesn’t do anything for the chrominance resolution. That 1.5x figure comes straight from the Panasonic Technical White Paper, incidentally, ( ftp://ftp.panasonic.com/pub/Panasonic/Drivers/PBTS/papers/AG-HVX200.CCD-WP.pdf ) at page 3: “Spatial Offset technology will improve the resolution by a factor of 1.5 provided the gain in resolution is not offset by the quality of the lens.”

Hence although DVCProHD is capable of RECORDING 1080 chroma samples vertically (it’s a 4:2:2 recording), the camera front end can only supply it with information corresponding to 540. This was my analogy to a container half empty. (If anyone disputes that, ask them what happens when confronted by a blue lines on black test chart, such that only the blue pixels produce an output. It CAN’T resolve better than 540 vertically.) Now take a camera such as the EX which has 1080 r,g,b pixels vertically, and here the front end IS capable of supplying 1080 chroma samples. Unfortunately, the 4:2:0 subsampling throws every other one away, so again the nett result is 540 RECORDED chroma samples. Hence the analogy of trying to pour a litre into a 0.5 litre pot, half gets spilt. Far from “rationalizing why, in theory, the EX1 should still be better at color than the 200 or 170” as David Jimmerson suspects, I’m actually saying that they both have more or less the SAME vertical chroma resolution RECORDED, 540! (Though the EX is capable of supplying better via HD-SDI.)

Now move on to the 151, and here the 4:2:0 recording of AVCCAM means it has the capacity to record 540 vertical chroma pixels – which matches nicely what the front end is capable of. Hence all three examples end up with effectively 540 vertical res recorded.

It’s a different topic, but it’s worth thinking about recording 720p instead of 1080. The 151 720 codec records full raster 1280x720 in this mode, DVCProHD records 960x720. The resolution of the front end should be around (960x1.25)x(540x1.25) from theory (about 1200x650), which matches an AVCCAM 720 raster very well. Record to 720p DVCProHD and quite a lot of horizontal detail is lost. Hence for a 151, 720 recording should preserve as much luminance detail as 1080, whilst giving the compressor a much easier time.

What isn’t clear from the original quote at the head of the thread is that in the original DVinfo thread it came from I was replying to a question about how effective it would be to use a CV XDR with a 151 (see post 62 of the original thread), and was addressing a very specific circumstance rather than a general 422/420 one. Take that into consideration, and what was quoted makes more sense.

At the end of the day, all this is only one factor in making a camera choice, though it’s good to understand the technicalities. Personally, I think the SDHC card ability of the HMC151 versus P2 of the 171 is a far, far more significant factor than nit-picking over resolution numbers, and the extra difficulty of editing AVCHD can be overcome by transcoding on import. If you’re looking for a “B” camera to an otherwise 2/3” P2 shoot, the 171 and P2 may be the way to go, otherwise the advantages of SDHC seem to make the 151 a better choice than a 171 for the vast majority of people.

Hope that helps answer your query,

David"
 
email 2

"Yes, please do reproduce my reply to you if you wish. I’ve looked again at that thread since sending you the reply, and note that quite a lot extra has been subsequently said, and we seem now to have a Panasonic marketing person contradicting a Panasonic White Paper! (The one referred to in my first e-mail to you.) The no of pixels involved for each colour are 518,400 (960x540), and it’s true to say that red, blue give different positional information to green, hence a total of 1,036,800 potentially different sites. This I believe to be where a 1 megapixel figure comes from, I’m not sure about 1.1MP?

But it’s wrong to then say it equates by pixel shift processing to a 1 megapixel luminance sensor for two main reasons. Firstly, unlike a true 1MP sensor, the r/b and g pixels optically overlap, and secondly that for peak white stimulation the r/b or g sites will only give out half a corresponding luminance unit. It’s generally accepted (including in the Panasonic white paper) that the improvement factor therefore comes down to about 1.5x the non pixel shifted chip dimensions, so the 0.5MP chips here used get a boost to the order of about 0.75 MP equivalent, far from insignificant. Because the effect is spread equally between the H&V axis, that makes it equivalent to about 1200x650 in resolution terms (1200x650=780,000). There is actually a lot more to it than that, such as trade offs of diagonal resolution for hor/vert, aliasing issues, etc but the above is a good first approximation.

As another poster stresses, this is for luminance only. Ask yourself what the result would be of a series of blue/black horizontal lines, 540 blue, 540 black? The DVCProHD codec could certainly record the pattern if it was presented, but vertically, each camera chip pixel would be presented with one black, one blue, so the chip certainly couldn’t resolve it. Go to in between situations, (pink, pale yellow lines, say) and the system may well then resolve more than 540, but nearly all the extra information will then be in the luminance recording channel anyway.

Hope all this makes sense.

David"
 
Bounce;1483990 quoting David Heath said:
That 1.5x figure comes straight from the Panasonic Technical White Paper, incidentally, ( ftp://ftp.panasonic.com/pub/Panasonic/Drivers/PBTS/papers/AG-HVX200.CCD-WP.pdf ) at page 3: “Spatial Offset technology will improve the resolution by a factor of 1.5 provided the gain in resolution is not offset by the quality of the lens.” Hence although DVCProHD is capable of RECORDING 1080 chroma samples vertically (it’s a 4:2:2 recording), the camera front end can only supply it with information corresponding to 540.

But he is missing the point on the entire picture here. It is breaking down to a level that it becomes confusing because it is taking the numbers out of its context and asking each to operate in isolation. This is what happens when you look at 540 on this looks like 540 on that I mean yeah 540 is 540, but how does that 540 relate to the rest of the codec, its prefilter and final compression. It is a complex thing and for the most part, it seems like a fruitless way of comparing unless the only thing you want to prove is numbers. Pictures on the other hand get you paid.

This was my analogy to a container half empty. (If anyone disputes that, ask them what happens when confronted by a blue lines on black test chart, such that only the blue pixels produce an output. It CAN’T resolve better than 540 vertically.)


The Blue in HD makes up 7% of the HD signal and as with the red anology above, not much is all the right color blue that will not be a combination of colors and thus lend a hand to the luminance resolution which is 70% of the picture. Blue in and of itself makes such a small contribution it is hardly worth noting. Red is only 23%.

Now take a camera such as the EX which has 1080 r,g,b pixels vertically, and here the front end IS capable of supplying 1080 chroma samples. Unfortunately, the 4:2:0 subsampling throws every other one away, so again the nett result is 540 RECORDED chroma samples.

What David seems to be missing is that the 4:2:2 denotation is a ratio. It isn't a matter of how many as compared from one camera to another, it is a ratio of how many as compared to its own luminance sample. Thus it is a 4:2:0 signal with every other line having no color at all. 4:2:0 has color on every other line. That is engineering.

Hence the analogy of trying to pour a litre into a 0.5 litre pot, half gets spilt. Far from “rationalizing why, in theory, the EX1 should still be better at color than the 200 or 170” as David Jimmerson suspects, I’m actually saying that they both have more or less the SAME vertical chroma resolution RECORDED, 540! (Though the EX is capable of supplying better via HD-SDI.)

Well it is not true that the recordings of the EX1 has better color than that of the HVX. It may be that the recoding coming off of the HD-SDI into DVCPRO HD would be better but never on an HDV nor on XDCAM-EX recording.

Now move on to the 151, and here the 4:2:0 recording of AVCCAM means it has the capacity to record 540 vertical chroma pixels – which matches nicely what the front end is capable of. Hence all three examples end up with effectively 540 vertical res recorded.

This is the same sort of thing that I have been saying since I joined this thread. 540 is not the maximum number of resovling points on any of the 540X960 imagers and this is due to the offset. Even though the guy references the document he clearly does not understand it. This feels like a bunch of smoke as this person has clearly had no hands on experience with the camera nor the AVCHD codec. It also seems pretty apparent that he has sat through one too many Sony presentations. ( I say that because of the silly agrument of the chroma numbers comparison above, that is a biggy in their presentation, and they just fail to denote that the designation is a ratio of color samples to its own luminance) The more luminance resolution to cover with the color the more spread out the count becomes. It is a ratio to itself.

At the end of the day, all this is only one factor in making a camera choice, though it’s good to understand the technicalities. Personally, I think the SDHC card ability of the HMC151 versus P2 of the 171 is a far, far more significant factor than nit-picking over resolution numbers, and the extra difficulty of editing AVCHD can be overcome by transcoding on import. If you’re looking for a “B” camera to an otherwise 2/3” P2 shoot, the 171 and P2 may be the way to go, otherwise the advantages of SDHC seem to make the 151 a better choice than a 171 for the vast majority of people.

I bring it back to a similar assessment. It is driven by budget and the rest of what you are trying to do. If you have the budget, the DVCPRO HD will net you a better result in that it doesn't have to make it to 21 mbs and go long GOP. This is useful where there is a lot of motion and details in motion. It is also helpful when you are matching with the larger cameras, the texture of the codec will be similar. However, not everyone has the jingle in the pocket for P2 and DVCPRO HD, and the HMC150 does a very good job of making images that will stand up to any other low end codec and frankly will do a better job, as it is a great codec in its ability to smartly distribute its resources where needed. It is not always a 8X8 block, it is variable, going as small as 4X4 and as large as 16X16. As mentioned in a previous post, AVCHD is to HD what DV was to SD. The HMC150 is an awesome little camera and its implementation at 21Mbs, is unparalelled in the Long GOP world(within its price point striking diistance).

Best,

Jan
 
email 2

"Yes, please do reproduce my reply to you if you wish. I’ve looked again at that thread since sending you the reply, and note that quite a lot extra has been subsequently said, and we seem now to have a Panasonic marketing person contradicting a Panasonic White Paper!
David"


Well since I wrote that White Paper I certainly know what it says. And what I am saying does not contradict what is explained in that paper.

Best to all,

Jan
 
Would then an MPEG-2 long-GOP at 100 megabits have more info than the DVCPRO HD intraframe?
Probably yes, provided that other factors are kept the same (such as recording frame size and color ratio).

Meaning, if you compared 4:2:0 MPEG-2 long-GOP against 4:2:2 intraframe, obviously the intraframe would have more info, all other things being equal. But the only implementation of 100mbps MPEG-2 that I know of is not exactly equal; it's 100mbps, and 4:2:2, but it's also full-raster 1920x1080 (as opposed to DVCPRO-HD's pre-filter of 1440x1080 PAL, or 1280x1080 NTSC).

So in a case like that, it'd be fair to say that yes the 100 megabit long-GOP codec would have more info than the 100 megabit intraframe, assuming (and it seems a reasonable assumption) that the nature of the long-GOP efficiency will overcome the additional bandwidth of the 33% to 50% larger recorded frame size.
 
Originally Posted by BobDiaz
Correct me if I'm wrong about this, but I'm not aware of any HDTV camera for under $10,000 (USA price) that captures a full 4:2:2 color. Even the Sony EX1 & EX-3 are 4:2:0 color. Both the Canon A1 and H1 are 4:2:0 color.


Bob, you are wrong.

Best,

Jan

Let me re-state this..

Correct me if I'm wrong about this, but I'm not aware of any (Non-Panasonic) HDTV camera for under $10,000 (USA list price) that comes with a lens, that captures a full 4:2:2 color.

Did I miss something at NAB and DV Expo?

If yes, who makes it and what is the model?

Bob Diaz
 
This was my analogy to a container half empty. (If anyone disputes that, ask them what happens when confronted by a blue lines on black test chart, such that only the blue pixels produce an output. It CAN’T resolve better than 540 vertically.)

I'd been the advocate of this way of thinking for some time. Until yesterday - when I realized I'd been wrong.
Sure it's only blue sensor that is sensitive to blue color. It's true that blue sensor can't resolve more than 540 vertically. But having pure blue is rare in the real world.
Now, let's take cyan into account. Various cyan grades are much more common - they all consist of both green and blue. It is a MIX - just like luma - the only difference is that luma consists of all three - green, blue and red with proper weigths. So the cyan is the MIX of the two sensors' outputs - green and blue. Cyan is not resolved by blue sensor - it is resolved by both blue and green. Since green is half-pixel shifted against blue the spacial offset technology is capable of resolving more cyan-colored samples! Pixel-shifting works for chroma in exactly the same way it works for luma - because most colors are a MIX of various basic colors, just like luma, which is a MIX (weighted average) of all three basic colors.
 
If I had a bit more time I could produce screen grabs to show everyone, BUT I do have a class starting in about an hour and I do need to get ready for it....

If I take any photo of things, there is almost never a 100% pure red or 100% pure blue or 100% pure green in the colors. You can prove this with Photoshop, just take any photo and grab a color with the Eyedropper, and look at the RGB values for that color. Most of the time, it will have a mixture of Red, Blue, and Green. (Even that bright red car isn't 100% pure red.)

I can't do it now, but tonight, if I don't forget, I'll post some screen grabs showing this...


Bob Diaz
 
I'd been the advocate of this way of thinking for some time. Until yesterday - when I realized I'd been wrong.
Sure it's only blue sensor that is sensitive to blue color. It's true that blue sensor can't resolve more than 540 vertically. But having pure blue is rare in the real world.
Now, let's take cyan into account. Various cyan grades are much more common - they all consist of both green and blue. It is a MIX - just like luma - the only difference is that luma consists of all three - green, blue and red with proper weigths. So the cyan is the MIX of the two sensors' outputs - green and blue. Cyan is not resolved by blue sensor - it is resolved by both blue and green. Since green is half-pixel shifted against blue the spacial offset technology is capable of resolving more cyan-colored samples! Pixel-shifting works for chroma in exactly the same way it works for luma - because most colors are a MIX of various basic colors, just like luma, which is a MIX (weighted average) of all three basic colors.

I'm not an expert on this, but wouldn't the effect you are talking about result in either green or blue fringes along the edge on a cyan object. Does the camera have some clever algorithm to prevent this from happening?
 
OK, here's a look at some the the colors I've grabbed from Photoshop. I chose a shot I took at the LA Auto show with bright colors on the cars. Now, I chose to grab a lot of the darker parts of the colors, because the RGB values are always lower.

Here's the main shot:
Picture10.png


The dark blue of the headlamp still has some Green and Red in it:
Picture11.png


The dark green of the headlamp has some red and blue in it:
Picture12.png


The red of the headlamp has some blue and green in it:
Picture13.png


The red car paint (see the red car to the left) has some blue and green in it:
Picture15.png


The blue in my son's shirt has some green and blue in it:
Picture16.png


Those who have Photoshop can try it with this photo or any other photo, it's hard to find any normal color that is just 100% pure red or 100% pure green or 100% pure blue.


Bob Diaz
 
From David Heath:



"I’ve had another look at the thread you initially linked to, and it’s a bit frustrating to see some of the points I raised pecked over, given meanings and nuances that were never intended, and be unable to respond. Yes, it’s obviously true that total blue virtually never occurs in nature (let alone as perfect blue/black lines J), but that misses the point – it was intended as a hypothetical extreme example to underline a technical point.

Maybe the most relevant points are raised in posts 47 by trez, and post 49 by studio1972. I’ll try one last time to explain, and would be happy for you to post this e-mail on my behalf. Trez very sensibly brings up the question of “what about cyan?” so let’s use this as the basis of an example. It’s limiting not to be able to use diagrams, and the inevitable problem is knowing how far to simplify reality for clarity without losing too much accuracy, but I’ll do my best.

Imagine first a camera with 960x540 sensors, and no pixel shift. The active area is each is a square in the actual pixel site itself, and all the red, green, blue sites are aligned. Now imagine a horizontal line of light one pixel wide moves up the sensor, and to use Trez’s example it’s a cyan line. It should be obvious that it’s vertical position can’t be defined to any closer than 1/540th of frame height. Also, it must affect the green and blue sensors equally, so there can never be any ambiguity about what colour it is – cyan.

Now let’s introduce a half pixel pixel shift vertically, moving the blue pixels up by 1/1080 of the frame height to sit mainly directly over the dead spaces between photosites of the green sensor, and let’s imagine the same horizontal cyan line moving up.

Two things will immediately be different. Its position can be defined more precisely than 1/540 of frame height, and as it moves it will change from mainly illuminating blue sensors, to mainly green, to mainly blue etc. No longer is the colour unambiguous – it depends at what place we do the measurement. Do the same theoretical analysis with ANY colour horizontal line, and the overall conclusion is the same.

Which brings us on to the point made by studio1972 – “…wouldn't the effect you are talking about result in either green or blue fringes along the edge on a cyan object. Does the camera have some clever algorithm to prevent this from happening?”

And the answer to both those questions is a resounding “YES”, the latter a comparable process to De-Bayering with a Bayer sensor, and why the DSP in these cameras runs at 1920x1080 – it makes the maths easier.


To use video engineering terminology rather than mathematical, then in this case pixel shifting has undeniably improved the vertical luminance resolution (you know more accurately where the line is), but with no matching increase in chrominance resolution, which is the point I’ve been making all along. Pixel shifting works for luminance (resolution), not for chrominance. In the case we’re talking about here chrominance res sticks at 540 lines max.

Practically, implementations are far, far more involved than that, the theory gets much more complicated and much depends on individual chips, differing algorithms, to say nothing of lens performance. I fully realize that single pixel horizontal lines are as rare in real life as pure blue colours, but they are classroom devices to try and help people understand fundamental theory. We could go into matrixing aspects, or aliasing issues in a lab, but that wouldn’t help understand basic principles.

I’m not sure why all this seems so controversial, I’ve already said that I consider pixel shift a sound technique built on principles related to the physiology of the eye. I do think two things are being widely misunderstood. Firstly that luminance resolution and chrominance resolution are two separate factors, and secondly that this whole 4:x:x notation is only applicable to recording systems, not cameras as a whole.

Practically and in the real world, the question is how much it all matters? Overall, I’m the first to say “not that much”. But let’s remember the quote from me that was originally used to start this thread was initially a response to someone who asked about using an external recorder (CV XDR) with a 151, and was asking if the 422 aspect of the XDR would give a better result. To stop him wasting money, I replied I didn’t think so (though the lower overall compression may help), as the internal recording system of the 151 and it’s 1080 420 nature was already suited to the front end. I still think that’s true, I’ll leave everybody else to make up their own minds."
 
[/I]
Correct me if I'm wrong about this, but I'm not aware of any (Non-Panasonic) HDTV camera for under $10,000 (USA list price) that comes with a lens, that captures a full 4:2:2 color.
If yes, who makes it and what is the model?
Bob Diaz

Okay, so any non-Panasonic, there is none and in fact you can raise that $ sign to $25,000 and it still wouldn't get you 4:2:2 in any make other than Panasonic. Within Panasonic yes, starting with the AG-HVX200A and the AG-HPX170. They record in full 4:2:2 called DVCPRO HD.

Best,

Jan
 
From David Heath:



"I’ve had another look at the thread you initially linked to, and it’s a bit frustrating to see some of the points I raised pecked over, given meanings and nuances that were never intended, and be unable to respond.

Why doesn't he just register and post? This third-party posting is awkward and should stop.
 
From David Heath:
...
Practically and in the real world, the question is how much it all matters? Overall, I’m the first to say “not that much”. But let’s remember the quote from me that was originally used to start this thread was initially a response to someone who asked about using an external recorder (CV XDR) with a 151, and was asking if the 422 aspect of the XDR would give a better result. To stop him wasting money, I replied I didn’t think so (though the lower overall compression may help), as the internal recording system of the 151 and it’s 1080 420 nature was already suited to the front end. I still think that’s true, I’ll leave everybody else to make up their own minds."

I wish David would sign up for the forum and post directly, but overall, we seem to be talking about something that is so slight, it's unlikely to matter. I get the feeling that some may believe that the edges of objects land exactly on pixel boundaries and transitional pixels do not exist; thus we could have some red+blue/green edge.

Several years back, Barry Green posted some images from the HVX-200 in the different modes. One of the images was DVCPRO50 (720x480). Now, even a 960x540 images sensor has more than enough pixels to resolve that, but when I blew the image up to 10x size, it shows that the edges are not as exact as you might expect:

DV50-Green_Zoom.jpg


So even if we had a 100% pure green background with a 100% pure (blue, red, or blue+red) line, the line almost never lies directly between the pixels. Thus, we will have transitional pixels between the boundaries of the background and the line.


I could get very technical here and go into sampling theory and why things work they way they do, but a simpler approach is to point to the HVX-200 section of this forum. Many of the users there also work with the higher end 2/3" cameras. If the 960x540 image sensors posed a real problem, we would have heard a massive outcry from the HVX-200 users years ago.

The perfect video camera does not exist, but given how popular the HVX-200 is, it shows that the technology does work and it works at a high enough quality level to get a loyal and happy group of users.


Bob Diaz
 
Bob.. always a good calming voice. Why does this rear up all the time. Who the hell has the time to care about such things. Get a cam.. and get to work with whatever tool is best for you. Shoot, some people are still buying DVXs..
 
Who the hell has the time to care about such things.

People planning their purchase. People confused with different opinions looking for real explanations. People wanting to know how things work. Your experience could really help them, Justyn.

Get a cam.. and get to work with whatever tool is best for you.

This won't help those people much. Someone who's buying the camera wants to first learn which tool is best for him and then get it. Also, you will never learn why spacial offset increases chroma resolution by running with your camera and shooting. To me the knowledge is precious and it seems there's bunch of people who think the same way.

It is ridiculous to me that some people complain about why this topic comes over and over again. There reason is we haven't had a good explanation yet.
 
Here's my two cents on this – as if anyone asked...


There is so much back and forth one the subject that after about the 3 page it becomes white noise.
We should research cameras and software before we use them but there are things that people won't/don't think about until after the fact and those people will 9 times out of 10 go online to known forums for insight or a point in the right direction.


At some point there has to be something conclusive or it will remain white noise.
Until then most people will fall back on “The images look good to me” and rightfully so.


People like Bob and Justyn keep it “real” so to speak and for that I say “thanks”.:thumbup:


Really, before I came to this site I thought little red, green and blue elves lived in my cameras painting pictures on my sd cards.:beer:
 
Just a bit of history, the debate of the 4:2:2 of the HVX-200 came up in early 2006 and it did get a bit ugly. I recall one person posted an insult to someone and became banned from the forum.

The whole thing ended up with the bottom line, "Look at the image that comes from the camera!!!" By then, there were enough people using the camera who could stand up and say it really looks good and had the results of green screen & blue screen tests to prove that it could be done without problems.

IF the image from the HVX-200 had sucked rocks, we would have heard about it long ago. Today, we have the same system in the HVX-200a, the HPX-170, and the HMC-150. The CCDs are improved, but from what I have seen, the improved CCDs have helped reduce the noise in the low light footage. So, the change is for the better.

I don't know of any image tests comparing the HMC-150 to the HPX-170; If anyone knows of such a test, please post the link to the results. Both cameras use the same lens and CCDs, so my own guess is that any difference is going to be small, but it would be nice to see proof one way or another.


Bob Diaz
 
And I second Bob's synopsis, the 150 and the 170 look very similar, the recording codecs look a little different and from there it becomes application and/or budget driven.

All the best,

Jan
 
Back
Top