Lenses and Optics

The (sort of) Great 400mm Lens Shootout!

I get asked a lot about different telephoto lenses. Is the 400 DO II better than the 400 DO? Which is better, the Tamron 150-600mm or the Sigma 150-600mm? You’ve probably noticed that I don’t answer those questions. The reason is simple. Our optical bench is designed to test lenses up to 2.5kg weight and a maximum of 250mm focal length. Most super telephotos fall outside that range.

Some old picture or me carrying lenses, because the editor counts pictures in the articles but doesn't read the captions.

Some old picture of me carrying lenses, because the editor counts pictures in the articles but doesn’t read the captions. I know it’s an old picture because if we had an area with that much empty space Tyler would have put 6 workstations in there. Note From Editor: I read the captions.

 

But, of course, we’ve spent most of the last 10 years figuring out how to do things we aren’t really supposed to be able to do. The truth is, with some reprogramming (like overwriting the expected focal length in the software), really careful technique (like a long delay for vibration dampening between each measurement after the machine moves), and a few other manipulations, we’ve found we can test most lenses at 400mm with good reproducibility.

Notice I said most. One lens you’ll see missing today is the Nikon 400mm f/2.8 VR II. Now I do expect that Nikon fans will claim a major conspiracy, but the truth is simpler: the first 400mm f/2.8 VR II is the heaviest super telephoto we tried. When we did, I thought there might be a bit of vibration-induced variance in the results so I don’t think they’re valid and don’t want to post them.

Now Swear the Solemn Oath! (Yes, you have to repeat it out loud.)

Animal House, Universal Pictures, 1978

Animal House, Universal Pictures, 1978

I do solemnly swear that I understand the following.

  1. The reason 400mm was chosen is because it seemed like a nice round number, and there are lots of lenses that get there.
  2. A given lens’ results at 400mm aren’t necessarily similar to those at 300 or 600mm.
  3. These tests were performed on a machine that isn’t designed to handle these lenses, and therefore may, or may not, be all that damn accurate.
  4. The MTF graphs are the average of multiple copies, but for many of the lenses, we used 5 copies instead of 10. These were time-consuming.
  5. A lens tested at f/2.8 should have lower MTF than one tested at f/4, etc. So don’t say something stupid about a f/5.6 lens being as good as a f/2.8 lens.

Also, I promise not to ask Roger to repeat the tests at f/8, or 600mm, etc. because I realize the bank’s going to come take his machines away if he doesn’t start doing some stuff that generates revenue soon.

Very good, you are now members of the Delta Tau Chi optical testing fraternity.  You may now read on.

The Canon Supertelephoto Primes

This is the section for both of you who want the absolute best lens at 400mm, and money is not (or at least not much) of an object. If you’re a Nikon shooter, just pretend the Canon 400 f/2.8 MTF curve says “Nikon 400mm f/2.8 VR”, and then skip on down. The 400mm f/2.8 lenses are pretty identical.

Canon 400mm f/2.8 IS II: The Gold Standard

This is optically the best telephoto there is, and all other lenses are measured by how close they can come to this one. It should be the best, it’s very big and breathtakingly expensive.

Olaf Optical Testing, 2016

Olaf Optical Testing, 2016

The Canon 400mm f/4 DO IS II

A lot of Canon shooters want to know how close they can get if they give up a stop of aperture and get the markedly less expensive and amazingly lighter 400mm DO II. The answer is at f/4, the 400mm DO IS II is basically as good, at least in the center 1/2 of the image where most telephoto subjects rest, as the 400mm f/2.8 IS II is at f/2.8.

Olaf Optical Testing, 2016

Olaf Optical Testing, 2016

 

Let me emphasize that this is the DO II. The original isn’t quite as good as you can see below (The DO II is on the right).

Olaf Optical Testing, 2016

Olaf Optical Testing, 2016

 

And while we’re answering questions Canon telephoto shooters ask all the time, let’s compare the 400mm DO IS II to the Canon 300mm f/2.8 IS II with a 1.4x Mk III teleconverter since these are both f/4, of similar size, and similar cost. The 300mm + 1.4X combination, is, of course, 420mm so it is a bit longer range.

Olaf Optical Testing, 2016

Olaf Optical Testing, 2016

 

As you can see, the 400mm DO IS II is a little bit sharper than the Canon 300mm f/2.8L IS II with TC combination on the bench. In the real world, though, the 300mm with TC combination offers some other advantages (like being able to be a 300mm f/2.8 when you want) that may be more important than the MTF curves. As an aside, we experimented a fair amount with the 300mm f/2.8 and 1.4x combos. First using the same lens with different converters, then using the same converter with different lenses. The converters don’t vary as much as the lenses, which makes sense; they’re optically much simpler than the 300 f/2.8 lenses.

The CaNikon Supertelephoto Zooms

OK, the vast majority of us aren’t interested in a $10,000 lens that requires a heavy duty tripod to use effectively. That is a specialist’s tool. We are more interested in that zoom or prime lens that can get us to 400mm at a fairly reasonable price. I understand you’re also interested these days in the third-party lenses that do that and we’ll get to those next. But it’s important to look at your brand’s offerings first, so you have that comparison point. (Spoiler alert: If you shoot Canon you’ll probably love the 100-400 IS II; if you shoot Nikon you probably won’t love the 80-400 VR II).

The Canon 100-400mm f/4.5-5.6 IS II

The Canon 100-400mm f/4.5-5.6 IS II is generally considered one of the best telezooms on the market and it’s MTF curves tend to support that idea. Remember, though, with the zooms we’re looking at them at f/5.6 at 400mm. That’s two full stops less aperture than the 400mm f/2.8 we started with. But the Canon is excellent at 400mm as you can see.

Olaf Optical Testing, 2016

Olaf Optical Testing, 2016

And just because I wanted to know, we tested the old, but excellent Canon 400mm f/5.6 L prime lens, for comparison. Few people shoot it anymore, but there’s a reason it’s remained in production for decades. It’s not quite as good as the 100-400 IS L, but still, an excellent performer considering how old the design is. (In the lab. In the field I’ll take the IS every time).

Olaf Optical Testing, 2016

Olaf Optical Testing, 2016

 

The Nikon 80-400mm f/4.5-5.6 ED AF-S VR

Commonly called the 80-400 VR II, this lens has been the Nikon 400mm zoom for some time now. It’s, well, it’s better up to about 300mm, but it’s just not that good when you stretch it out to 400mm. Not a great performance for a lens that demands a premium price.

Olaf Optical Testing, 2016

Olaf Optical Testing, 2016

 

Nikon 200-500mm f/5.6E ED AF-S VR

The newer Nikon telezoom is something of a different beast. It’s a fixed aperture lens and it zooms out to 500mm, so it’s the first lens in this test that can actually go past 400mm. Plus it’s a lot less expensive than the older 80-400mm. I can’t comment on how it performs in the field, but from an MTF standpoint, it outperforms its much more expensive brother at 400mm.

Olaf Optical Testing, 2016

Olaf Optical Testing, 2016

 

The Third-Party 150-600mm Zooms

These recent entries in the super telephoto zoom market have changed things quite a bit. The Sigma Contemporary and Tamron lenses both can be had for under $1,000; much cheaper than the brand-name zooms. The Sigma Sport is a different lens, being almost 50% heavier and about twice the price of the other two.

There is one HUGE, IMPORTANT thing I want you to take away from the MTF curves on these lenses. At 400mm the two Sigma lenses are at f/6.3 maximum aperture, the Tamron is at f/5.6. Now I don’t think that half stop is going to affect your shooting significantly, but it probably will have some effect on MTF curves. The Tamron, Canon, and Nikon zooms we tested above are all done at f/5.6 and should each be at least a little better MTF stopped down. And yes, I know you wish I’d tested them all at f/6.3 to even the playing field. But I’ve got paying customers waiting and bills to pay.

Tamron 150-600mm f/5-6.2 Di VC USD

Just in case you missed it, the Tamron testing aperture is f/5.6 at 400mm, so we can directly compare it to the Canon and Nikon telezooms above.

Olaf Optical Testing, 2016

Olaf Optical Testing, 2016

If you make that comparison, you’ll see why, for quite a while now, I’ve recommended this lens to Nikon shooters instead of the Nikon 80-400mm VR II; its similar in sharpness, far less expensive, and has additional range. But at the same time, I’ve told Canon shooters if they want the sharpest zoom at 400mm, to stick with the Canon 100-400. Obviously, if they want 600mm range, then my suggestions are quite different.

The Sigma 150-600mm f/5-6.3 DG OS HSM Contemporary A1

The Sigma Contemporary is very similar to the Tamron in size, price, and obviously, range.

Olaf Optical Testing, 2016

Olaf Optical Testing, 2016

 

You can probably tell the Sigma has a slightly better MTF, but I’ll put them side-by-side below for easier comparison. I suspect that even if we stopped the Tamron down to f/6.3 the Sigma would be slightly better in the lab, but I also doubt the difference is nearly as great as the copy-to-copy variation. In other words, I wouldn’t consider MTF to be a significant factor when deciding between these two lenses. Things like how it handles, focuses, and how well the stabilization works are going to be way more important.

Olaf Optical Testing, 2016

Olaf Optical Testing, 2016

 

A Word About the Sigma 150-600 f5-6.3 DG OS HSM Sport A1

As I’ve mentioned, despite the similar names this is a very different lens than the Sigma Contemporary. One of those differences is weight and size. It’s the second heaviest lens we tested; only the Canon 400mm f/2.8 weighs more. But the Sigma Sport differs in that a lot of its weight is in a very heavy front element that sits at the end of an extending zoom barrel, which for purposes of testing at 400mm is partially extended. When we tested it, slight vibrations interfered with testing enough that we had several bad readings for each lens. For that reason, much as I wanted to compare the Sigma Sport to the Sigma Contemporary, I just don’t have enough faith in the results to make them public.

Summary

I don’t think we really did too much here today except to have some fun and confirm, in numbers, what most people already know. The 400mm f/2.8 lenses, if you can afford one and don’t mind carrying it, are amazing. Canon’s new 400mm f/4 DO IS II is also superb, at least as good as the 300mm f/2.8 IS II with a teleconverter.

Canon’s 100-400 IS II is, from an MTF standpoint, the best zoom at 400mm, but the Nikon 200-500 and both the Sigma and Tamron 150-600s are also really good, far less expensive, and have greater range. The Nikon 80-400 VR II is not quite as good at 400 as the competition.

 

Roger Cicala, Aaron Closz, and Markus Ruthaker

Lensrentals.com

August, 2016

 

 

Geek Note: Some of you may have noticed the two Nikon lenses seem to have astigmatism right in the center, which is, to say the least, unusual. This is one of the things that has more to do with our testing than reality. Remember we test the lenses rotating them so we take 4 slices to get a complete picture of the lens. With these heavy, extending barrel zooms, the barrel tilts a bit with extending, so the center doesn’t quite stay in the center, it’s a few mm off center in some rotations. Here’s a random 80-400 as an example, showing you all 4 quadrants of MTF.

275124_small_Rotation

You can see that the best center is the 45-degree rotation, but at other rotations, the best reading is slightly off-center. We can have a geek argument that maybe we should recenter at each rotation; it would make prettier MTF curves. My thought was nope because the whole purpose of the 4 rotations is to look at the different areas of the lens at the same position, just like it would be in an image. Besides, this is the way we’ve always done it. But let me add that that is NOT the way the manufacturers would do it. They show you a single cut, so, in this case, our 45-degree cut should be closest to the manufacturer’s ideal.

 

 

 

Author: Roger Cicala

I’m Roger and I am the founder of Lensrentals.com. Hailed as one of the optic nerds here, I enjoy shooting collimated light through 30X microscope objectives in my spare time. When I do take real pictures I like using something different: a Medium format, or Pentax K1, or a Sony RX1R.

Posted in Lenses and Optics
  • Kevin Crosby

    That was my experience as well. I was on location in the Tetons when we saw a mother Grizzly and her cubs out about 120 meters. Just did not get a sharp image out of the whole bunch.

  • kimbentsen

    My thoughts.

  • Martin Kozák

    200/1.8L with Canon 2x III is not usable, both optical quality and AF speed/accuracy is bad. 1,4x is much much better.

  • CheshireCat

    Thanks, Roger. That nails it 😉

  • Nope.

  • John Neufeld

    did you try any 200mm f/2 or f/1.8’s with a Canon 2x III?

  • MS

    It would be very interesting to see how Sigma 50-500mm performs against 150-600mm lenses.

  • More that there just weren’t enough in stock to test 🙂

  • James Cameron

    I found it quite decent at close distance (a few meters away) but resolution was dropping significantly as the distance increased. And I’m not talking about infinity focus, but regular medium range that is common for sports and large animals.

  • Sean T

    I assume it’s lower on the list because it’s also ferociously expensive and unusual.

  • Allen Gambrell

    Where is the Canon 200-400 f4 Zoom? I would love to see how it stacks up agaist the 100-400.

  • Sean T

    I love you Roger. This is great! Thank you so much. Airydiscus said this wouldn’t happen and I’m delighted that you were able to work through the technical challenges.

    Dear Nikon – instead of producing yet more kit zooms, how about a better 80-400 that’s not pathetic for the price? At least we have the 200-500!

    I’m excited for my Sigma Sport rental in November for birding. Let’s see just how terrible that thing is to carry, and let’s see if I can tell any difference in IQ versus my Tamron 150-600!

  • Bill Ferris

    Clearly, you’ve not done much BIF photography at these f-ratios.

  • Alan, I’m hesitant to put much credence in sample variation on this test, since we were beyond specs of the lab equipment. But given that, there wasn’t much difference in variation and it was pretty much as you’d expect: Not much variation in the prime lenses, quite a bit in the extending barrel zooms, and they were all kind of similar. But that could be that there was similar bench variation, too, which is why I didn’t put up those graphs.
    Roger

  • Alan Fersht

    Roger, I have had a long career as a quantitative experimental scientist and really appreciate your approach of multiple measurements combined with statistical analysis and repetition on different samples, which stands out in the world of lens reports. There are so many sites that make pronouncements on a single sample of a lens, which sometimes are quite different from yours. Comparisons of the Tamron 150-600mm and Sigma C are typical. So, I would love to know whether these lenses do have a large sample variation or it is just poor testing?
    Alan

  • Chesire, we’ve done a comparison of the original 100-400 to the VII a year or so ago, you can google it. But the quick summary is it’s nearly as good in the center, but not after you get 1/2 way to the edges. Still, for 400mm shots most people are just worried about the center. That being said, there’s a pretty big difference in how effective the IS is; at least 1.5 stops from what others have determined. There may be an AF accuracy/speed difference too.

  • Alan, I think I mentioned the 420mm length in the article. It can be a difference maker.
    As to variation, I’m just not comfortable publishing it since we were out of spec for the machine: we might have been getting more variation because of that. I don’t think so, but I’m not certain. I did mention, though, that the 1.4X TCs had almost no sample variation, which did make sense.

  • Allan Richardson

    CheshireCat – I own them both and nearly threw the old 100-400 over-board on a couple of occasions on pelagic birding trips because it could not track seabirds accurately. The new manifestation is so far ahead that it is simply out of sight. It focuses far more quickly and accurately with a 1.4x converter attached than the original does bare. The new lens is a truly professional quality lens in an affordable package for every-day photographers. It focuses closer than the 70-200mm offerings and the extra two stops of image stabilisation make it so versatile especially if you want to convert it. I shoot it wide open with a converter and the results are very impressive.

  • Jacobus DeWet

    I own the 80-400 vrii and a 300 f2.8vrii that I use extensively with TC’s. I was not 100% happy with my first 80-400 but the second lens that I now use is an exceptional lens. There are a lot of Nikon Shooters that use this lens and find it to be top end. As for the 300 f2.8, to me size and handling and flexibility on top of outstanding results with both the TC 1.4 and 2.0 is the reason I will not replace it with the fantastic but heavy and big 400,500 or 600mm lenses. Fact is there is always a compromise, we all have to decide what we are prepared to live with.

  • Ritvar Krum

    1/3 stop advantyage is NOT “significantly less noisy” – it is precise only 1/3 stop (assuming that t-stops are equal, wich are not, but we have no data – so assuming they are). however I do agree that consumer lenses really stepped up significantly

  • CheshireCat

    Thanks for the very interesting test. I think the big absent is the old Canon 100-400, which many 400-lovers own and would like to understand if it is worth upgrading.

  • Alan Fersht

    The 300mm + 1.4xTC is 420mm. I am not splitting hairs or making a silly point. The extra 5% focal length over 400mm gives 5% greater resolution, roughly equivalent to a 5% effective increase in MTF in the field vs a 400mm.
    It would be interesting to see the sample variation for the different lenses.

  • Bill Ferris

    The performance of the consumer lenses is impressive, especially the Nikon 200-500mm, f/5.6E and the Sigma 150-600mm, f/5-6.3 Contemporary. The 1/3-stop advantage of the Nikon may not seem significant, but when shooting birds in flight in overcast light at 1/2000, that translates to a less noisy image…significantly less noisy if there’s any cropping to be done in post.

  • Reilly Diefenbach

    Having rented both the Tamron 150-600 and the Sigma Sport with high hopes from Lensrentals and shot them on a D800e, I can say that the former is just plain soft at 600 with very poor rendering, the latter fair, with excellent focusing and good color. Neither is outresolving the D800e or any DX imo. Sample variation? Bah. I don’t care a hoot for mtfs, only what appears on my monitor when I shoot a bird at distance. I can see no difference near infinity focus between the latest 400 2.8 and any of the three Nikon 300mm primes with 1.4 t.c., all of which can be cropped to a faretheewell. Close in, the 400 2.8 is a bit better, although the bokeh close to the subject is horrible at times at 2.8.
    All four primes are sharper than any camera FX or DX through most of the frame and have excellent color, contrast, in focus to out of focus transitions, highlight handling, the whole laundry list of lens qualities that will never appear on any chart. I’m happy as could be with the 300PF plus t.c., although I would never turn down a 400 PF :^)
    Having shot the 80-400 a number of times, I agree it is soft at distance, but close in it is absolutely phenomenal. As good as it gets. But distance is where the money is for most wildlife shots.

  • Ben, it’s a good point, but I’m just not sure what I saw was real world (other than the lens is really big and long). One major issue is with the bench the IS system isn’t active. In the real world the IS might have handled that vibration. There were other things too, that may have more to do with an overloaded machine than a real world correlation. I’m not sure, and i don’t think it’s fair to publish a test that I’m uncertain is accurate.

  • RLThomas

    The real shocker in all this great info is that the kids won’t let you play with the toys all the time. That’s really sad. You should start a GoFundMe for Roger’s Playpen. I’m good for $10.

    Randy

  • Ben

    Regarding the Sigma Sport, I understand from a scientific perspective not wanting to share results that you have trouble reproducing. However, if you can’t get consistent results even when taking as many precautions as you do to isolate vibration, don’t you feel that’s indicative of the results people will see in the real world? I guess what I’m saying is what’s the harm with posting them with the caveat that these were the best results you could get and that they were inconsistent? Maybe you could even get another whole article out if it.

  • Just dropping in to say that I know the inability to tell the difference between tangential and sagittal curves in the charts’ legends was something I had complained about in the past — so thank you for fixing it.

  • Kevin Crosby

    I rented the Nikon 80-400 and was completely un-impressed with it. As Roger indicated pushed out to 400mm it is really soft. I rented and know own the Tamron 150-600 which for me is MUCH sharper and better performing piece of equipment.

  • King

    the Nikon 200-500mm f/5.6E is worse than the tamron 150-600mm, judging by my own test over a 1 month periode.

Follow on Feedly