Geek Articles

Third Party Ultra-Wide Lenses MTF Comparison

Contrary to what most people believe, we do pay some attention when people ask us to do MTF testing on certain lenses. I’m not saying we do it, but we do pay attention to the requests and when we have some downtime will look at that request lists and see if there’s something on it we can get to. One thing that a lot of people have asked about is how the third-party ultra-wide angle zooms look. Certainly, there’s reason for interest. The third-party alternatives cost far less than the newer brand-name ultra wide lenses.

We’re going to put them out in one post, but really the three third-party ultra wide options aren’t all directly comparable to each other. The new Sigma 12-24mm f/4 DG HSM Art lens is an alternative to the Canon 11-24mm f/4 L. The Tamron 15-30mm Di VC USD provides an alternative to the Canon 16-35mm f/2.8 L lenses and the Nikon 14-24mm f/2.8 ED AF-S. The Tokina AT-X 16-28mm f/2.8 Pro offers an even lower cost option.

To be clear, MTF charts shouldn’t be the first consideration when choosing an ultra-wide zoom. Things like flare-resistance, vignetting, and whether you can easily use a filter on the lens may all be more important than absolute sharpness with an ultra-wide zoom. But sharpness is always nice to know about.

Remember, as always, that all of the lenses were tested at the widest aperture. This means the f/4 lenses would be expected to be sharper than the f/2.8 lenses if all else was equal. If a f/2.8 lens is nearly as good as a f/4 lens on these tests, then you would expect it to be better once stopped down to f/4. To simplify things for those who want to tell me they want to see what the f/2.8 lenses look like at f/4, I’d be happy to. It costs around $4,000 to bench-test a set of 10 ultra-wides, so just let me know the check’s on the way, and we’ll get right on it.

In the meantime, here are the results of the tests we have done.

MTF Results

I’m going to start by just giving the MTF graphs for the three third-party ultra-wide zooms. Since these are 2X zooms, we tested them just at the two extremes. (OK, truth is ultra-wide lenses take foooorrreeeevver to test on the optical bench, our patience isn’t all that good, and we decided to use that 2X thing as an excuse not to do the center of the focus range too.) We’ll present the MTFs for each lens with the widest end on the left.

Sigma 12-24mm f/4

Olaf Optical Testing, 2016

That’s pretty good at both ends of the range, but most impressive at the wide end which is clearly sharper both on and off axis than the long end. Since most people are going to use an ultra-wide at the wider end, I think that’s a good choice.

Tamron 15-30mm f/2.8

Olaf Optical Testing, 2016

The Tamron also puts it’s best at the wide end, and it’s quite spectacular there. Remember this is at f/2.8 which should make a lower MTF, but it’s just about as good as the Sigma. But also remember the Sigma is vastly wider, which is a tough thing to do. So far, though, I’m impressed with the third-party offerings.

Tokina 16-28mm f/2.8

Olaf Optical Testing, 2016

The Tokina is a bit older in design and by far the least expensive of the ultra-wide zooms. At the wide end, it’s not bad. Not as good as the Tamron, but acceptable. At the 28mm end, though, it’s really pretty weak. Still, it’s adequate at the wide end, and most people have the longer end covered by a 24-70 or similar alternative lens. Given the very low price of the Tokina, it would give a lot of individuals a practical ultra-wide option.

MTF Comparisons

I thought it would be useful to do some graphs giving direct comparisons between the third-party wide zooms and a few of the brand-name lenses they would be alternatives for.

Sigma 12-24 f/4 Art vs. Canon 11-24 f/4 L

We’ll compare at both the wide and long ends with the Canon on the left, Sigma on the right. Remember the Canon is at 11mm while the Sigma is at 12mm in this graph. Here is the wide end of the range.

Olaf Optical Testing, 2016

 

The Canon is a tiny bit better than the Sigma, but this difference is small, and I doubt you’d see much difference in actual use. Copy-to-copy variation is greater than this difference in averages.

And here they are at 24mm.

Olaf Optical Testing, 2016

 

At 24mm the Canon has a clear advantage in MTF, one that would probably be noticeable, although the Sigma has lower astigmatism-like separation. The Canon would have a clear resolution advantage at 24mm. On the other hand, the Sigma has a $1,200 advantage at checkout. If I were buying the lens to use at the wide end mostly, the Sigma would have to be considered a very viable alternative.

Tamron 15-30mm f/2.8 vs. Canon 16-35mm f/2.8 Mk II

I suspect the comparison to the Canon Mk II lens is more pertinent and probably fairer. The Mk III is a brand-new release costing $2,300. The Mk II is still widely available new for around $1,450, while the Tamron is about $1,200.  We’ll compare the Tamron to the Canon 16-35 Mk II first. Remember this is at the extreme of the zoom range, so in this first chart, we’re comparing the Canon at 16mm to the Tamron at 15mm.

Olaf Optical Testing, 2016

While the Canon has a little sharpness advantage right in the center, off-axis the Tamron looks much better with less astigmatism and higher resolution out near the edges.

Now we’ll look at the long end, by comparing the Canon at 35mm to the Tamron at 30mm.

Olaf Optical Testing, 2016

The Tamron’s still a bit better, although things are more even now. As I mentioned, there’s a lot more to choosing an ultra-wide zoom than MTF, but these curves would suggest the Tamron deserves strong consideration if you’re considering the Mk II Canon.

Tamron 15-30mm f/2.8 vs. Canon 16-35mm f/2.8 Mk III

OK, if you’re planning on buying a Mk III, then you probably aren’t considering third-party alternatives. That lens is a good example of sometimes things are expensive because they’re worth it. But I thought the Tamron’s performance was really good and for fun thought we’d post it up against the new wide-angle MTF champ and see how it looked.

Olaf Optical Testing, 2016

 

Olaf Optical Testing, 2016

 

That’s a pretty credible performance for the Tamron. Sure, it’s not as good as the Canon Mk III, but it’s still pretty damn good for $1,000 lower sticker price.

Nikon 14-24mm Comparisons

The Nikon 14-24mm f/2.8 has, until the Canon 16-35mm f/2.8 Mk III, been the gold standard of all wide-angle zooms. Lately, you’ve been able to find it refurbished or as gray market for only slightly more than the Tamron 15-30mm f/2.8, so I thought that comparison would be appropriate, too. Here is the Nikon at 14mm compared first against the Tamron at 15mm and the Tokina at 16mm. Remember, though, the difference between 14mm and 15mm is pretty noticeable.

Olaf Optical Testing, 2016

 

Olaf Optical Testing, 2016

 

The Tokina is obviously not as sharp as the Nikon, but as we mentioned above, at the price they’re asking it’s definitely usable. The Tamron matches up pretty well, though. A tiny bit less sharp in the center but perhaps a bit sharper in the edges, although with more astigmatism / lateral color.

Conclusions

From an optical point, the MTF tests agree with what people have said for some time. The Tamron 15-30mm f/2.8 is certainly competitive with the Canon and Nikon wide zoom lenses. It’s certainly worth consideration if you’re buying in this range. Of course, as I said earlier, there’s a lot to consider in a wide zoom that has nothing to do with MTF. If the shooting you’ll do makes Vibration Control useful, this is the lens for you. If you want to use screw on front filters, this isn’t.

The Tokina is decent at the wide end, but not so much at 28mm. I’ll add that while I’m not putting up variance numbers with these, the Tokina’s were all over the place at 28mm. There was one copy that was every bit as good at 28mm as it was at 16mm. The majority were pretty poor, though. I say this because I’m sure some people have copies of this lens that are good at both ends. But I think they would be the exception. Still, given its price and the fact that most people use other lenses at 24mm and up, it’s certainly worth looking at, especially for those who only shoot wide occasionally.

 

Roger Cicala and Aaron Closz

Lensrentals.com

January, 2017

 

 

Author: Roger Cicala

I’m Roger and I am the founder of Lensrentals.com. Hailed as one of the optic nerds here, I enjoy shooting collimated light through 30X microscope objectives in my spare time. When I do take real pictures I like using something different: a Medium format, or Pentax K1, or a Sony RX1R.

Posted in Geek Articles
  • Stanislaw Zolczynski

    Well, it`s 1000$ lens so maybe some care went into manufacturing it. An italian Leica ambassador wrote it`s worth the money.vieribottazzini.com/2016/08/voigtlander-heliar-hyper-wide-10mm-f5-6-review.html

  • Andrej Belic

    thanks I’ve waited for a very long time for this test.

    I’ve also asked myself why testing isn’t done at ´higher f-stops but now I know

  • Well, yeah, m4/3 . . . . but I also remember us testing the 15mm Super Heliar. Tell me you want to do that again? 🙂

  • Athanasius Kirchner

    Well, since you mentioned it yourself, and on the topic of reader requests, how about a disassembly of the K-1? You use(d) one, don’t tell me you’re not curious to see how the vaunted Pentax construction holds up 😉
    Pretty please, with sugar on top?

  • Athanasius Kirchner

    Excellent link, many thanks for it!

  • Brandon Dube

    The f/0.95 M4/3 lenses (17.5mm, 25mm, 42.5mm) are quite well assembled. I measured them when I did the panasonic-leica 42.5mm f/1.2. About as good as the 50/1.8 STM.

  • Sebastián Santos

    Yes, I was thinking the same. The Canon 70-200 and the 1.8 primes are horrible lenses.

  • OK, I see your point. But when I do comparisons like that it brings the fanboys out in droves and that makes me go insane. I’ll run the tests eventually, but I dread writing the article.

  • There’s very little customer interest, not enough that we’d ever have 10 copies to test. And the copy-to-copy variation on Voigtlander’s is so high I wouldn’t even consider testing an individual copy or even 3 or 4. Most of them are simple ‘stack’ lenses: Element, spacer, element, etc. There’s no optical adjustment, what you get is what you get.

  • DrJon, it is indeed superb. But I didn’t want to compare it to the f/2.8 lenses, and it’s not nearly as wide as the ultra-wide f/4s.

  • DrJon, I honestly don’t know. By the strict definition then pancakes would indeed be telephotos. I’m not certain that they all have positive front elements and negative rear elements, though.

  • The physical length generally includes the distance between the sensor/film and the front of the lens.

  • DrJon

    Oh, and as it’s more likely to be seen here can I throw in a question about an old article please?
    In: https://www.lensrentals.com/blog/2011/02/who-invented-the-telephoto-lens/
    You say “the actual definition of a telephoto lens is a lens with a physical length shorter than its focal length”.
    So does that mean most Pancake lenses are Telephotos? Or do you need a positive front element and a negative rear element as well? (I’m assuming that, but it wasn’t clear.)

  • DrJon

    The Canon 16-35 f4 is also a pretty good price, so can I ask how does that compare to the 3rd party lenses?

  • Omesh Singh

    As a Canon shooter the Nikon system looks quite appealing with the updated 70-200/2.8E, 105 and host of great f/1.8 primes. The Tilt-shift could be the final straw that shifts the camel’s hump… wait that’s not how the idiom goes.

  • Stanislaw Zolczynski

    I know you must be tired of ..try test this and try test that so I`ll just ask about Hyperwide Heliar 10mm/5.6. Is there any customer interest in it. After all it`s the widest rectangular on the market.

  • MEJazz

    Thanks

  • I don’t know many people who are trying to decide between those two lenses 🙂

  • Carleton, I think Paul van Walree’s article on it is the clearest presentation around: http://toothwalker.org/optics/astigmatism.html

    As to how it manifests in photos it depends on lots of factors. In general, the effect would be seen in fuzzier fine details, sometimes in bokeh, occasionally in lines looking sharper in certain directions than others. The best example, is one van Walree uses. If you have an astigmatic lens and took a picture of a bicycle wheel hanging on a wall, you could either focus on the spokes (sagittal lines) or the rim (tangential lines) but not both.

  • It’s a lens I shot with back in the day and it wouldn’t have compared well. Even then it was considered pretty soft away from center even stopped down. But it was the only 12mm there was and we were pleased to have it!!!

  • Omesh Singh

    I’m still keen to see how the PC-E 19mm stacks up against the TS-E 17mm.

  • MEJazz

    Any idea how would the older Sigma 12-24mm f/4.5-5.6 AF II DG HSM would be compared to the new f/4 ART?

  • I think there was a bug in the name server or something that affected the blog articles for 30 minutes or so.

  • Carleton Foxx

    Even though I suffer from a nasty case of astigmatism myself, I have trouble understanding how it manifests itself in a photo. Could someone explain what it looks like and in what situations it would be particularly detrimental.

  • obican

    This one: https://wordpress.lensrentals.com/blog/2015/07/a-quick-look-at-the-new-sigma-24-35-f2-art/

    Yesterday when I clicked the Blog link on top, it would directly go to that link. I tried a few times and thought OK, maybe he’ll do direct linking to new articles from now on and I read the piece.

    I had not checked the date :).

    When it got “removed” later, I figured maybe there was something wrong within the article and you removed it. Apparently it was just a bug that somehow brought me up a very old link directly.

  • obican

    Not sure, did you put an article yesterday and took it off a few hours later?

  • obican

    What happened to the Sigma 24-35 article?

  • Jaime

    Nice comparison, but I’d like to know autofocus performance, are they good performers as the Canon?

  • miejoe

    Samyang 14mm? Cheque is in the mail. I can’t guarantee it won’t bounce though : )

    I’m just trolling of course – thanks for the well-written article. It’s laid out in a way that makes it very practical for those of us researching these lenses.

Follow on Feedly