Lens tests - stock vs. new Zeiss ZF 35mm vs. 30-year-old Zeiss Jena 35mm

Barry_Green

Moderator
So, I got in the first of my new batch of Zeiss ZF lenses, and I thought I'd put it to a simple chart test. Run through the apertures, see how contrast & sharpness hold up, etc. Then, for grins, I decided to put it up against the stock lens, same aperture, same (basic) focal length. And then, I dug out my old $40 Zeiss Jena M42 screwmount lens, and put it on there too.

Tests were to see how the lens resolves at various f-stops, both in stills and movie mode.

Prediction: there won't be much if any difference among any of them in movie mode, but there should be a noticeable sharpness difference in the order of ZF > CZJ > stock.

Actual results? Well... hmmm.

First, lens properties at various apertures, in stills mode, as compared to their own selves (not comparing to each other).
ZF: Sharpness is pretty decent throughout the range, up until f/22. F/22 goes too far and sharpness really falls off. Looks best from 5.6 thru 11.

CZJ: flat contrast, but reasonable sharpness, at 2.4. Nicely sharp and contrasty at 5.6. Some aliasing present, implying that it's sharper than the sensor can resolve. Contrastier, and perhaps slightly less resolving, so that the chart actually looks better with no aliasing at f/11. At f/16 it's not as good, definitely softer and flatter. At f/22 it goes to pot.

Stock lens: looks like hell at 5.6. I mean, to be fair, it's still resolving maybe 1100 lines, but compared to the Zeiss, it's getting beaten like a US soccer team. But, I'm not supposed to be comparing across lenses yet, so ... at 5.6, kind of soft & fuzzy. At f/11, it's night and day. Way, way better than 5.6. Crispy sharp, with aliasing even showing up. This lens likes f/8 to f/11. At 16, we're headed back the other way. Softer and flatter, than at f/11, but still miles better than f/5.6. And, no aliasing -- so it might even be rendering "better" images at f/11, but they won't have that extra-crisp "pop." At f/22, it's the same noisy/muddy mess that the other lenses turn into.

Which tells me that we're probably seeing major diffraction ruining the image at f/22. All three lenses perform similarly at f/22. My recommendation for still shooters is avoid f/22 with *any* lens, on a GH1. Just don't go there. You can get good results at f/16, but f/22 is too far and diffraction softens the images.

Okay, so now that we know how the lenses perform in and of themselves, how do they compare to each other?

At f/2.4, the Zeiss ZF looks, to my eye, not as nice as the 30-year-old Carl Zeiss Jena lens, in terms of chromatic aberration -- there's a little bit more in the ZF as opposed to the slightly cleaner CZJ. The resolving power in the center is about the same, and they're both beating the pants off the stock lens (at 5.6!) but the ZF seems to have some purple chromatic aberration tint to it, that the CZJ doesn't. The corners are an odd situation -- the ZF slays on the left, the CZJ wins on the right. I don't think the camera moved at all between the setups, so ... that's odd. Overall, score a win for the CZJ for f/2.4. The stock lens isn't even in this game, of course, because it can't open that wide.

At f/5.6, the two zeiss lenses are near identical, and both are so laughably superior to the stock lens that it seems seppoku would be the only way out for the poor 14-140. Between the ZF and the CZJ, I'd say the CZJ has a whisper more detail, but it's so close as to be not really even relevant. In the corners, the ZF is clearly sharper and contrastier, putting out so much detail the GH1 starts aliasing. So for f/5.6, the ZF wins, CZJ is a decently close second, and the stock is a distant third.

At f/11 -- same story between the Zeiss lenses. The ZF may have a tiny edge, but it's splitting hairs to find it. They're basically identical. The stock lens? It looks just as good! By f/11 the stock lens has come to play. It's sharp enough to be causing aliasing too; all three lenses are outperforming what the GH1's chip can handle. This is pretty much a three-way tie, at f/11.

At f/16 -- the ZF is maybe two hairs ahead of the CZJ at this point. It's still very close. They're both a decent edge ahead of the stock lens. The stock is still competing, not bad at all, but a small edge goes to the Zeiss brothers. ZF wins, CZJ is a close second, and stock is a close third.

At f/22 -- The ZF is definitely beating the CZJ. Not night and day, but by a respectable amount. The stock lens doesn't embarrass itself, it puts in an okay showing for sharpness. But, the zeiss lenses are showing a little oranghe chromatic aberration, and the stock isn't. Overall, a three-way tie.

So -- that's how they performed in stills comparison. I expected the Zeiss lenses to beat the stock, and they did, and oh boy how they did. What I didn't expect is how well the CZJ did! Not bad at all for a 30-year-old $40 lens, as compared to its brand-new $1,000 counterpart!

The ZF is still nicer, slicker, and better; after Duclos gets through with it it should be a reasonable approximation of a cine lens. And it's a half-stop faster. And it has nicer focus travel and build quality and on and on... But for bang-for-the-buck purposes, the Carl Zeiss Jena 35mm/f2.4 really acquitted itself very well!

(note: it's tough to remember everything when doing one of these comparos, and the thing I forgot this time was to re-white-balance between each lens change. As such, to remove unfair color cast issues out of the comparison, I used the auto-adjust features of PhotoShop).
 
Now, moving on to how it performs in a video environment -- stills are all nice and dandy, but what are the differences once you swap over to 1080/24p mode? How will the lower resolution and aliasing effects of the DSLR play out with the comparison of these three lenses?

I shot the same chart, same tests, in video mode, and then extracted a still frame from each movie in CS4.

ZF - at 2.0, it looks a little less contrasty than at 2.4, but there's no difference in resolution. It's already aliasing pretty much from the start, with the lens delivering more than the camera can handle. And that stays true all the way to f/16. At f/22, it does look a little softer, again likely attributable to diffraction.

CZJ -- 2.4 is definitely flatter contrast than 5.6. Resolution is the same though. The diff. between 5.6 and 11 looks to be a very slight gain in resolved detail, but mostly in aliasing. At f/16, aliasing looks a little bit less, but contrast looks like it must be a little softer too. The aliasing is still basically there, but the blatantness of it is a little lower. At f/22, it's noticeably softer, with milder aliasing -- presumably diffraction is taking away the excess alias detail.

Stock -- the stock lens performs pretty much identically from 5.6 to 11. There's a slight softening of aliasing, but no loss of real resolution, at f/22.

Conclusion there -- Sharpness differences don't really seem to be affected by f-stop much at all, and f/22 is surprisingly usable. I wouldn't use it in stills, but in video it's okay, according to the chart. The resolved detail on the chart actually looks cleaner because there's less aliasing polluting the image.

Okay, for lens compared to lens:

At f/2.4 -- no difference, the Zeiss lenses tie. Stock lens can't go to f/2.4 so it's not a factor here.

At 5.6 -- no difference, they all deliver an equally sharp image. Actually the stock lens looks slightly better, with less aliasing. I'd score this one a very close win for the stock.

At 11 -- for sharpness, the ZF and the CZJ tie. The ZF seems to have a cleaner image in regards to chromatic aberration, the CZJ seems to have picked up some orange/red CA. There's slightly less aliasing on the stock lens, and a slight reduction in chroma noise with the stock lens. Again, the stock wins here by a nostril hair, with the ZF coming in 2nd and the CZJ just barely trailing in third.

At 16 -- it's really kind of spooky as to how identical the two zeiss lenses are. The stock lens looks just as good, and even a bit better because there's a bit more contrast. Stock wins, ZF and CZJ tie for second.

At 22 -- The zeiss lenses are again almost identical, with just a bit more C.A. on the CZJ. Both are slightly contrastier than the stock. I'd score this one ZF, CZJ, and third goes to stock.
 
Last edited:
So -- what is this really saying?

Am I actually saying that the cheap stock lens is just as good as a $1,000 Zeiss prime? Well, for video purposes -- yeah. Pretty much. The HDSLRs simply can't "see" the better performance of the better glass. And make no mistake, the Zeiss glass is *way* better, you can really see the night-and-day difference in stills performance. But for video, the way the SLRs work, and their native resolution, can't really take advantage of the better res of the stills glass!

Shocking? Yes. Goes against everything you've ever heard? Probably.

But it also means that if you're wanting to put together a prime lens set, for video purposes, there's really no *sharpness* advantage to spending a fortune on the best glass. When measuring resolved detail, a decent old ebay $40 M42 Zeiss Jena performs just about as well as a top-flight Zeiss ZF, and the stock lens you already have performs just about as well as either of them (except for wide-open f-stop!) No doubt that the stock lens isn't all that good at all compared these stills lenses when you shoot still photos! But when it gets to video, there just isn't enough there to make much of a difference with.

Well, that's all based on charts anyway. And a black and white chart, at that -- What about with a still-life? What happens when you bring color and texture and shades into it?

Well, I set this up, and shot with each of them. You tell me if you see a huge difference between them, and which shot was shot with which lens. Recognize that color and contrast are properties of lenses and you will see a difference, especially in contrast. But do you see a sharpness difference? And if you do, can you tell me which one came from the $1,000 prime lens, and which one came from the $30 ebay lens, and which one came from the stock zoom?

There are three BMP files here, which are uncompressed frame grabs from three separate movie recordings, one each of each lens.

These embedded shots are JPEG extractions. Click on each shot to download the uncompressed full-resolution 1920x1080 still frame.

First, from lens "A":



Next, from lens "B":




And finally, from lens "C":
 
Last edited:
stock lens...i don't feel so underprivelaged due to my lack of money after following what you're coming up with. i always root for the underdog anyway. i'm a SD Chargers fan...i'm comfy with it :-)
 
Cliff Notes version: if you don't see a big difference in those pictures, then there's not a whole lot of incentive for you to go out and spend a bunch of money on lenses. Unless you're shooting stills, because you definitely will see the difference when shooting stills!
 
Many thanks again for taking the trouble to do this - and for providing a tutorial in effect on How To Judge Tech Quality of Images (Photo & Video)! Huge amounts of general and specific useful info there.

Frame C seems to me to have a noticably different character from A & B and I would wildly guess that it's the stock lens therefore. It gives the appearance in the fine text on the bottle of being slightly less sharp but that could be a result of its lower contrast - which does give a less punchy image, but it's "seeing" stuff in the shadows which can't be seen in the other two images.
 
Cliff Notes version: if you don't see a big difference in those pictures, then there's not a whole lot of incentive for you to go out and spend a bunch of money on lenses. Unless you're shooting stills, because you definitely will see the difference when shooting stills!

Very useful comparison, Barry. Thanks for taking the time to do it.

This discussion seems incomplete without at least some mention of bokeh.

And there's not a lot of incentive to spend more money unless you want to do this :D

Password = constant2

 
A = More contrast and or therefore more saturation/deeper colors
B = Almost like A but a little less saturation or contrast
C = Not so much contrast, looks like slightly less resolution but might be due to contrast

If I had to pick one Id take lens A

Sami
 
If I had to pick one Id take lens A
Do you find "A" to be worth $40 more than the others?
Do you find "A" to be worth $836 more than the others?

That's really the question I'm hoping to address here, as to whether SLR users should feel like they need additional lenses for their video, or whether they'll really see any improvement at all(!) And if not, maybe our lower-budget folks can be content with the stock lens, if they don't really see the improvement from the better glass.

I will say that I definitely think the ZF is worth it, from the stills improvement and the construction quality and the soon-to-be cinema-zation of it and the three extra stops of sensitivity. I'm not knocking it or saying it's overpriced at all. I'm just raising the question of -- if your primary aim is 1080/24p from a DSLR, is it really going to give you any more sharpness? Really? Not from "common sense" or "conventional wisdom" but from actual on-the-ground testing...
 
a and b look pretty much exactly the same to me for all practical purposes. C looks more washed out and not as sharp... noticeably enough for me to not want to use it in comparison to the others.

later,
jason
 
after looking at the full 1080 versions of them (on a 2560 x 1600 rez 30" display [i didn't blow them up beyond their native rez though]). B looks slightly more appealing overall to me... looks a bit "sharper", but I'm not sure if that's b/c of the contrast difference. The blacks look more crushed in B, which may be what is giving me the appearance of greater sharpness/rez.

C, still looks noticeably softer and more washed out to me. maybe it's a contrast issue too... I wouldn't know.

later,
Jason
 
Am I actually saying that the cheap stock lens is just as good as a $1,000 Zeiss prime? Well, for video purposes -- yeah. Pretty much. The HDSLRs simply can't "see" the better performance of the better glass. And make no mistake, the Zeiss glass is *way* better, you can really see the night-and-day difference in stills performance. But for video, the way the SLRs work, and their native resolution, can't really take advantage of the better res of the stills glass!

Shocking? Yes. Goes against everything you've ever heard? Probably.

Not shocking to me. That has been my point in other threads. Sorry but glass is glass. The guys at Panasonic must LOL when they see people thinking that a prime lens is going to perform any better. A big fallacy. The only problem with the stock lens is that it only goes to f/4. Then again that is nothing that can't be fixed by throwing some lght into the subject right? Thanks Barry for your tests.
 
C shows more dinamic range. So whatever this lens is, has less contrast but that apparently captures a much better image.

A 50mm lens design is quite simple so i wouldn´t expect any major adances in technology for the last 30 years. 1980 is not that far away for a 50mm.
What i would expect is better longitudinal CA response from newer lenses, but that is something that the latest Zeiss (manufactured apparently by... Cosina?) suffers a lot and it has being criticized for.
 
I like the kit lens and think Panasonic has done a great job of rolling a lot into it and making it work pretty well all-around.

I've always had the thought in the back of my mind that the other lenses I've bought might be overkill considering the GH1's video capabilities. And Barry's tests seem to indicate they may be. At least on a quantitative basis if you figure the extra money spent versus the actual difference in results when looking at sharpness.

But, for me at least, there's more to it than that. I really think it comes down to what you're going to do with the lens. If you're shooting in situations where f/8 - f/11 works, and everything is going to be in focus the kit lens will probably serve you very well when compared to the others. Plus you have all the advantages of OIS, decent autofocus, etc. that the primes don't give you. But if you're doing a lot of nature footage (and I don't mean well-lit distant landscapes) the kit lens can drive you crazy unless you compose your shots very carefully. An oxymoron for sure - "Excuse me, Mr. Deer, would you mind standing still for just a second out in the middle of that sunny meadow and waiting for the wind to stop blowing the leaves?" Now I realize this is codec related, but it can be controlled better with lenses other than the kit lens.

However sharp the kit lens may be compared to the others when shooting video; let's not forget it's slow. This was originally the driving force that led me to consider other glass. I actually was deluded enough to originally think I would buy the GH1 and be satisfied with the kit lens. That didn't last long. Personally, I'm willing to pay for a faster lens for video. It's just so nice to know you can shoot with available light and get a great looking image. And then there's DOF. Of course you can get all of this without springing for an expensive lens. Yet, you might be willing to pay for the convenience of a fast zoom with little or no distortion or aberrations, and sharp throughout. Or a prime that is as top-notch wide-open as most are at their sweet spot. And I'd venture to say there may have been some color variations between A, B, and C (at least with C) had Barry done a white balance and not evened things out with Photoshop. Of course, these things can obviously be adjusted in post.

And last I come back to bokeh. Depending on what you're shooting, the quality of the bokeh can make the difference between an okay shot and a really pleasing one. Many of the Zeiss lenses have beautiful bokeh (as do others). How much is that worth? Of course, it's subjective. At any rate, if you want a lot of these factors in one package you're going to pay more for it. Just like anything else.

As for stills, as Barry says, there's just no comparison. So all things considered, I don't regret a penny I've spent on extra lenses.
 
Me either. I love the new lenses, they're faster, way better for stills, and the construction quality and focus slickness is just heavenly as compared to the stock or older lenses. And, I may use them in the future on cameras that may very well be able to take advantage of the additional sharpness that they offer.

But a GH1, a 7D, or a 5D are not those cameras. So what I'm saying here is -- if you want the best lenses and you can afford them, go right ahead and get them. But if you're a no-budget type of guy, which is probably why you're shooting with an SLR in the first place, and you can't afford to drop a few grand on great glass -- don't worry about it! As long as the stock lens can give you the f-stop you're looking for, it really isn't going to do much for your image to go buying the more-expensive glass!

And that's heretical, I know. But it's what the tests show, and I'll take real-world test results over "common knowledge" any day.

Better lenses are better for many reasons. But sharper glass doesn't really do anything for an SLR's HD video mode.

If you're looking for more f-stop, a 30-year-old SLR lens might deliver all the performance you need, and the expensive premium glass isn't necessarily going to get you a sharper image when you're working with SLR video.

My ZF's look night and day different through the VF/10x magnifier on the GH1 and the 7D. But you're looking at a 14- to 18-megapixel image there. When you go to the HD mode, it's gonna be a 2-megapixel image. About 85% of what you were looking at through the viewfinder is gonna get thrown away in the video image.

Build quality and contrast are issues you should be looking at, moreso than ultimate resolved detail, if you're looking for cheap glass that can still perform well with DSLR video.

But if you also want to shoot great stills, don't skimp on the glass, it makes a huge difference on stills performance.
 
Thanks for doing this test Barry! Very helpful to make lens choices.

It's nice to know that the old lenses are a viable option because the mechanics in the newer EF/AF lenses are not exactly 'cinema friendly', and those ZF's are pricey.

Do you think the results would be the same on the 7D?
 
Good test thanks.

I've been trying my Nikon primes on the GH1, and I would say it's virtually unuseable HH for video, without the OIS and shooting with anything remotely telephoto the Jello is dreadful. There is so much wobble. Maybe because the kit lens is pretty wide I don't see this as much.

I'm happy with the kit lens for video for all but the darkest environments.
 
Cheers Barry. Very heartening for me, as you know my ZF's are destined for another camera in time. The 7D is a short term prospect for personal use.
 
Back
Top