Lenses and Optics

Variance Measurement for 35mm SLR Lenses

Published July 13, 2015

Last week we posted optical bench MTF and copy-to-copy variation measurements for 50mm SLR lenses. We’re going to continue that series this week with the same measurements for the 35mm lenses. This set should fill out the wide-to-standard range lenses and gives us a lot of interesting data as we continue to look at what factors affect copy-to-copy variation. These lenses range in price from $200 to $2300 USD, includes a couple of lenses first released in the 1990s and several released in the last couple of years, complexity ranging from 4 to 10 groups with and without aspheric elements.

MTF Curves of the 35mm Lenses

Ten copies of each lens were tested on our Trioptics Imagemaster Optical Bench using the standard protocol, which we described in the introductory blog post. All lenses are tested at their widest apertures, so take that into consideration when comparing MTFs; stopping an f/1.4 lens down to f/1.8 or f/2.0 would improve its MTF. (And yes, I realize how nice it would be to have done the f/1.4 lenses at f/1.8 and f/2.0. I might get to it someday. Maybe.)

Let’s take a look at the MTF curves for the 35mm lenses. Below are the average curves for each lens. They are in no particular order of anything other than kind of trying to keep lenses of the same brand together.

Roger Cicala and Brandon Dube, Lensrentals.com, 2015
Roger Cicala and Brandon Dube, Lensrentals.com, 2015
Roger Cicala and Brandon Dube, Lensrentals.com, 2015
Roger Cicala and Brandon Dube, Lensrentals.com, 2015

 

The MTF curves for the f/1.4 lenses don’t show us much that we didn’t already know. The Sigma 35mm f/1.4 Art lens has the best resolution of the bunch. The Zeiss 35mm f/1.4 isn’t quite as sharp, but clearly is the second best. The Rokinon 35mm f/1.4 is very comparable to the name-brand glass and interesting in that it maintains excellent resolution all the way to the edges. The Rokinon 35mm has a tangential ‘bump’ at 2mm, like the Rokinon 50mm lens did. Again, this is an artifact of local distortion from the aspheric element that affects our testing, but would not affect your shooting.

If there’s a takeaway message from the MTF curves, it’s that if you don’t absolutely need to shoot at f/1.4, you can save quite a bit of money by grabbing the Canon 35mm f/2, Zeiss 35mm f/2, or Nikon 35mm f/1.8 G AF-S lenses. They’re all excellent. If you do need to shoot at f/1.4 and want the highest resolution possible, then you want the Sigma 35mm f/1.4. Note that I didn’t say the best lens, I said best resolution. There is more to the choice of a 35mm lens than simply resolution, but it’s always good to know what kind of resolution you are going to get.

Speaking of what you’re going to get, let’s take a look at how much copy-to-copy variation we can expect from these lenses.

Copy-to-Copy Variation

The simplest way to look at variation is with our Consistency number (for a complete discussion of how we arrive at the Consistency number, see this post). In summary, a higher consistency number means there is less copy-to-copy variation; the lens you buy is more likely to closely resemble the MTF average we presented above. In general, a score over 7 is excellent, a score from 6-7 good, 5-6 okay, 4-5 is a going to have significant copy-to-copy variation, and under 4 is a total crapshoot.

Here are the variation graphs for the 35mm lenses in the same order as we presented the MTFs above. The consistency number is in bold at the lower left of each graph.

 

Roger Cicala and Brandon Dube, Lensrentals.com, 2015

Roger Cicala and Brandon Dube, Lensrentals.com, 2015

Roger Cicala and Brandon Dube, Lensrentals.com, 2015

Roger Cicala and Brandon Dube, Lensrentals.com, 2015

 

The Consistency numbers for the 35mm lenses were generally poor, generally no better than the 24mm lenses. The two Canon lenses and the Zeiss 35mm f/2 all were above 6, and the Nikon and Zeiss 35mm f/1.4 lenses weren’t far behind. For the Nikon 35mm f/1.4 and Zeiss 35mm f/1.4 lenses particularly, the Consistency number doesn’t give as much information as the actual variation graph. If you look at the graph you’ll notice they are quite consistent in the center. Their variance comes in the outer 1/3 if the lens. This suggests thy will be quite consistent as far as center sharpness, but copies tend to suffer from a soft corner or soft side.

The other lenses had lower consistency. I was quite surprised at the Nikon 35mm f/1.8; the Nikon 50mm f/1.8 showed a lot less variation and I had expected similar performance with the 35mm f/1.8. Also, if you look at the actual graphs you’ll note that the Rokinon and Nikon 35mmf /1.8 tended to vary a lot at the center of the lens, meaning the variation here is affecting center sharpness, not just creating soft corners.

There’s not a lot of trending with the 35mm lenses. The Canon 35mm f/1.4 and Zeiss 35mm f/2 are two of the oldest designs, yet they also have good consistency scores, but the very best consistency score comes from the newer Canon 35mm f/2. The more expensive lenses (Canon 35mm f/1.4, Zeiss 35mm f/1.4, and Nikon 35mm f/1.4 G have good Consistency scores but it’s not something that seems significant. However, the inexpensive Rokinon 35mm f/1.4 and Nikon 35mm f/1.8 AF-S G do have the lowest Consistency scores.

I won’t repeat the trendspotting graphs we placed in the last post. You can look back at it and see the 35mm lenses were already mapped out on the variation-by-focal-length graph, just not labeled. We’ll put up the ultra-wide angle and short telephoto lens results in the next week and then follow with a summary ‘trendspotting’ article when we have all of our prime lens data to look at.

 

Roger Cicala and Brandon Dube

Lensrentals.com

July, 2015

Author: Roger Cicala

I’m Roger and I am the founder of Lensrentals.com. Hailed as one of the optic nerds here, I enjoy shooting collimated light through 30X microscope objectives in my spare time. When I do take real pictures I like using something different: a Medium format, or Pentax K1, or a Sony RX1R.

Posted in Lenses and Optics
  • Roger Cicala

    Andrew, we’re thinking exactly the same thing. I’ve heard Canon has built a couple of more roboticized assembly lines. I wonder if these better lenses are the ones coming off of those?

  • Andrew

    Fascinating, many thanks – as a manufacturing guy I am starting to wonder if Canon has done something to improve design for manufacturing. I am sure the consistency of their new primes is not just better quality control – perhaps there is a mechanical design reason for good element alignment. It will be interesting to see if this carries over into their newer telephotos and zooms.

  • derek

    A fascinating series of articles, not just up there, but beyond the autofocus accuracy series… which also stands alone as great reference material.

    looking forward to the 28s, thanks for your conciderable efforts.

  • AJ

    Thanks Roger,
    I appreciated how much work goes into a project like this (I’m a technical person).
    Thanks for your contributions to the photographic community. Highly appreciated.

  • Roger Cicala

    John, good pickup! I was going to include the 28mm with these, but it will have to wait until next post.

  • John Mc

    That 28mm in picture is just a test, right? I sees it.

  • JK

    I’ve really enjoyed these articles. Thanks!

  • Roger Cicala

    AJ we definitely are going to, but I want to get all the lenses done at wide aperture first. This really is a huge project, and that’s just for the primes.

  • AJ

    Thanks for the reply Roger,
    I’d assumed the sensor must be the same to remove a variable but thought it was wise to ask rather than assume.
    As for testing at the same aperture, I was thinking that maybe if the F1.4’s had similar performance at F2 and if one sometimes needed F1.4 then the 1.4 would have some benefit. On the other side of the coin, if the F1.4 lenses provided similar performance only at say F2.8 then one might find the F2 lens suits one better.
    As a comparison, perhaps you could just compare the best performing F1.4 vs the best F2 – unless the F1.4 is actually better at F1.4 than the F2 in the first instance 😉

  • Roger Cicala

    AJ it uses the same sensor for all lenses, that’s why we are moving to this type of testing. It eliminates lots of variables.

    We will do some comparison, but stopping down improves MTF a lot but we haven’t looked at what it does to variation. It will obviously improve things.

  • Thanks again, this is all very interesting.

    (After the great showing of the 50mm Art, I expected more from its 35mm sibling…)

  • Keith

    Thanks for this.

    Just a typo though, under “Copy-to-Copy Variation”, I have a feeling “Here are the variation graphs for the 50mm lenses” should be “35mm lenses”.

  • L.P.O.

    Just in case you already couldn’t guess this, but for a while waiting for your next article in this lens test thread has been pretty much as exciting as waiting for the next episode of Game of Thrones… except there is no given date and time for the next instalment. Yes, and because this isn’t one of the breaking-things-apart threads, there is slightly less six and violins.

    Sorry, didn’t really have anything new to add.

  • AJ

    Hi Roger,
    Thanks for the information you have been compiling on lens sharpness and variance. Very useful information, particularly when one reads other sites and the bun fights about which is the better lens (particularly as the variances are sometimes quite high within a specific model).
    Have you thought of normalising the information, in other words taking the lowest (FStop) common denominator (F2 in this review) rather? I would think that the results would then be more ‘comparative’.
    Just noting this as you have mentioned in some areas that the F1.4’s would provide better results when using a higher FStop – but not by ‘how much’.
    You’ve probably mentioned this before (and I’ve probably read it but forgotten) but might I enquire as to whether OLAF uses the same sensor for al the tests performed rather than brand specific?
    Anyway, thanks once again for the informative information you (and other lensrentals staff) provide.
    Cheers

  • Roger Cicala

    Thanks Aaron. The crowdsourced proofreading works again!

  • Lee Saxon

    You guys should look into a Javascript mouseover / A-to-B comparator like Lloyd Chambers uses, it’s really informative and easier to read that just having the graphs lined up one after another.

  • Aaron

    I think you have a typo in your 2nd to last paragraph:

    “Canon 35mm f/1.2”

    should be

    “Canon 35mm f/2”

    As far as I know, Canon doesn’t have a 35 f/1.2, and this isn’t about 50mm lenses 😉

  • A

    Thank you Roger (and all your minions), for doing this, and particularly for sharing the results with us. It is very much appreciated!

Follow on Feedly