MTF Testing for the Sigma 24-105mm f/4 DG OS HSM Art Series Lens
I generally let you know what my expectations are before I start, to hopefully let you know where my personal opinion affects things. The fact that I’m just posting tests of the Sigma 24-105mm f/4 DG OS HSM Art months after the lens was released tells you a lot. I’m not excited about testing 24-105mm lenses; it’s almost always ‘another one like the other ones.’
Don’t get me wrong; these are useful and popular zooms for a reason. I’ve owned several and used them a lot. The focal length makes them superb general purpose and walk-about lenses. But designing a zoom that goes from retrofocus to telephoto is a daunting task. My conclusion for almost every one of them has been “decent from 24mm to 70mm and usable past that if you need to.” I didn’t expect anything different from this lens, Art or not.
But the $899 price tag is attractive, compared to $1099 for the Canon 24-105mm IS II or Nikon 24-120mm f/4 ED VR. The weight of 855 grams (31.2 oz) makes it just slightly heavier than the Canon (795 g) and Nikon (710 g), so the weight penalty isn’t severe like it is with some Art lenses. So my expectation was definitely ‘another one like the other ones’ would be a success, given the lower price tag on the Sigma lens.
Optical Tests
MTF
If you don’t know that MTF stands for Modulation Transfer Function (1, 2, 3, 4), then just look at the pretty graphs and remember higher is better, the left side of the graph is the center of the image, and the right side is the edge.
At 24mm
This is really amazing center sharpness for a zoom. It does decrease away from the center but so does every 5X zoom. This is really exceptional performance.

Olaf Optical Testing, 2018
At 70mm
The center at 70mm isn’t quite as great, although that’s partly because the center at 24mm was so amazing. This is a really good MTF curve, though, and performance away from center is better than at 24mm.

Olaf Optical Testing, 2018
At 105mm
And here’s a bit of ‘another like every other.’ Performance at 105mm isn’t as good as at the shorter focal lengths, although this is still pretty good as comparisons will show later on.

Olaf Optical Testing, 2018
Sample Variation
Zooms tend to have a lot of variation, and 5X zooms more than 3X zooms, but f/4 helps keep that under control here. This is actually quite a good performance as far as sample variation goes, particularly at 24mm. This is similar to the degree of variation seen on Canon 24-105 f.4 IS II lenses, which we consider a nice, consistent lenses with limited sample variation.
24mm
70mm

Olaf Optical Testing, 2018
105mm
There is more variation at 105mm, but that is the nature of the beast. Every 24-100+ zoom has more variation at the long end.

Olaf Optical Testing, 2018
MTF Comparisons
The logical comparisons (that I thought of) are to the Canon 24-105 f/4 IS II and the Nikon 24-120 f/4 VR lenses. I’m sure someone is going to ask me to compare it to the Leica 21mm f/1.4 or something, but this made more sense to me.
Sigma 24-105mm f4 OS Art vs. Canon 24-105mm f.4L IS II
24mm
The Sigma’s performance in the center of the image is just amazing for a 5X zoom, and it remains better at least halfway to the edge of the image. In the outer 1/3 of the image, there’s not much difference. But the difference in the center of images at 24mm should be noticed fairly easily.

Olaf Optical Testing, 2018
70mm
The Sigma 24-105mm f/4 OS Art is still superior to the Canon 24-105mm f/4 II at 70mm, although things are closer. The Sigma also has less astigmatism-like separation between sagittal and tangential resolution, and that remains so all the way to the edge of the image. Generally, that results in a smoother look and better bokeh. (Yes, I realize not many are buying f/4 zooms for bokeh, but it’s worth mentioning.)

Olaf Optical Testing, 2018
105mm
The party is over at 105mm for the Sigma, and there’s virtually no difference between the two lenses at this focal length. Neither is as sharp as at shorter focal lengths, but both are still very usable.

Olaf Optical Testing, 2018
So what would you notice in photographs? I’m pretty comfortable you could tell the Sigma is better in the center at 24mm. I think you’d probably find the Sigma very slightly better at 70mm, but you might have to pixel peep a bit to do so. At 105mm any differences you see are just copy variation.
Sigma 24-105mm f4 OS Art vs Nikon 24-120mm VR
This shouldn’t be a fair comparison; the Nikon has a longer zoom range and is a much older design. But it has maintained a good reputation as an excellent walk-around and general purpose lens, and since the Sigma is available in F mount, I thought we should look.
24mm
Things are actually more even between the Sigma and the Nikon. The Sigma has better MTF at higher frequencies (fine detail) in the center and maintains a little better MTF away from the center. The Nikon, though, has less astigmatism-like separation.

Olaf Optical Testing, 2018
70mm
The Nikon is actually a bit better at 70mm in the center at higher frequencies, with things being very similar away from the center.

Olaf Optical Testing, 2018
105mm vs. 120mm
The Sigma doesn’t reach 120mm, and I don’t have data for the Nikon at 105mm, so this is the only long-end comparison I can do. Again, the Nikon at 120mm is performing at least as well as the Sigma at 105mm, which is most impressive.

Olaf Optical Testing, 2018
Would you see these Nikon-Sigma MTF differences in a photograph? I don’t think so. Sample variation is about as large as the difference between averages; so a given copy of the Nikon may be a little better, a little worse, or exactly the same as the Sigma. I would not choose between these two lenses on the basis of sharpness. There are other, more important, factors to consider.
Stopping Down
NOTE: Sorry to take so long getting these repeated. I took a couple of days vacation and wanted to do these myself and make sure I got them correct. We found the reason first set of graphs was incorrect: the machine had been set to test a different size lens, human error didn’t catch it, and the software didn’t have a built-in check, so it mapped the center 1/2 of the image out as though it was the entire field. The machine has been corrected, the software is being corrected, but the humans, until we can replace them with AI, remain human. We’ll make mistakes. The ultimate mistake is mine – I was more enthusiastic about something else I was doing and didn’t supervise this as closely as I should have. My thanks to those who made comments and pointed out the error.
In correct stop downs, we do still see dramatic improvement at f/5.6 in the 70mm images, a noticeable improvement at 105mm, but only a slight improvement at 24mm.
24mm

Olaf Optical Testing, 2018
70mm

Olaf Optical Testing, 2018
105mm

Olaf Optical Testing, 2018
Field Curvature
The field of focus curvature gives us a lot of information. When the MTF graph falls off at the edges, we don’t know how much is because the resolution is decreasing and how much is because the field of best focus is moving to another plane.
These are quad graphs: the upper left shows the ‘average’ field (the sagittal and tangential values are averaged). Lower left and right graphs separate the sagittal and tangential fields (which lets you visualize astigmatism to some degree – where the fields don’t overlap there is astigmatism). At the upper right is a difference graph showing you that astigmatism. Remember the plane of center focus is a horizontal line through the middle of each graph. Astigmatism behaves differently in front of, and behind, the plane of best center focus.
Again, this is a single lens, so you’ll notice a bit of tilt in the field. That’s because it’s a zoom and they all have a bit of tilt in the field. Unless it’s dramatic in this test (and none of these are), it’s not noticeable in actual photography.
24mm
At 24mm the field is really nice and flat, with just a little bit of curve at the very edges. (Geek MTF lesson – notice how the tangential graph doesn’t stay as sharp (yellow and orange) as the sagittal lines towards the edge of the image? You saw that in the MTF graph at 24mm, too.)

Olaf Optical Testing, 2018
70mm
At 70mm we begin to see a little U shaped curve in the field of focus. It’s not very strong, but you could probably notice it in a photograph. (My favorite real-world technique is to focus on a rock in the center of a mowed yard, then run a ‘find edges’ or similar filter on the image. You’ll see the field curvature.

Olaf Optical Testing, 2018
105mm
The sagittal cure maintains its slight U shape at 105, but the tangential field changes to a, well, I don’t know. Blob maybe?

Olaf Optical Testing, 2018
So What Did We Learn Today?
Well, my true confession is that I view 24-105mm f/4 lenses as sort of the Minivan of camera lenses; practical, useful, and totally not sexy. I’ll admit I use them a lot, but having one mounted on my camera makes me want a bumper sticker on my bag that says “My Other Lens is a Ferrari” or something.
I’ll also admit it has been a long-term policy of mine to never like any 24-105mm f/4 lens. My highest praise for a 24-105mm to date has been ‘doesn’t suck as much as I expected’. I’ve never veered from that policy while reviewing lens after lens after lens*. It has become a tradition.
I value tradition, so I’m going to make my summary ‘This is the Best Damned 24-105mm f5.6 Lens Ever Made’. Because did you see how amazingly good this thing is stopped down to f5.6 at 70mm? That is a remarkable thing for any zoom lens, and even more remarkable for a zoom that ranges from wide-angle to telephoto. Honestly, if you are shooting at f/5.6 I can’t imagine any lens at any price doing significantly better than this.
Even at f/4, the Sigma 24-105mm f/4 OS Art is still pretty amazing at 24mm. That center sharpness really shocked me. I wasn’t expecting that. Otherwise, this is a 24-105mm f/4 image stabilized lens that as good or better optically as any of the others I’ve tested and available at a lower price.
There are always other things that are more important when deciding if this is the lens for you, of course, but you can be very comfortable about the resolution being excellent and the sample variation is small. I’d call it clearly better, from a resolution standpoint, than the Canon 24-105 f/4 IS II. The Nikon 24-120 f/4 VR, though, is aging very gracefully and certainly holds it’s own at f/4.
And yes, I realize I’ve just said ‘this is the hottest Minivan on the market’ but hey, if you need a minivan, you might as well get the hottest minivan. Maybe paint some flames on the side, too.
Roger Cicala and Aaron Closz
Lensrentals.com
February, 2018
* The official lens reviewer terminology is if you’ve tried it once you say “in my experience”. If you’ve tried it twice, you say “in my series of tests”. If you’ve tried it three times, you say, “I’ve seen this in lens after lens after lens.”

145 Comments
William Dyer ·
I’ve used this lens on a Nikon D810 for several weddings and a funeral, and was impressed with how sharp it was at f 5.6 and f 8. I have no complaints other than its filter size. 77mm would have been nice. But life’s full of trade-offs. When I got the Tamron 24-70 2.8 G2, I considered selling the Sigma 24-105. This test validates my decision not to sell it.
Roger Cicala ·
William, please, please, tell me it was 4 weddings?
William Dyer ·
LOL! Well, yes, though over a couple of years. I’m only a part-timer camera wise.
William Dyer ·
LOL! Well, yes, though over a couple of years. I'm only a part-timer camera wise.
almeich ·
I would buy a lens based on a test (if the tester is reliable and reputable) provided I like the looks and feeling of the lens. Just like I would buy a car.
If I had a lens and considered selling it, no test in the world would matter. Only my guts feeling.
William Dyer ·
I've used this lens on a Nikon D810 for several weddings and a funeral, and was impressed with how sharp it was at f 5.6 and f 8. I have no complaints other than its filter size. 77mm would have been nice. But life's full of trade-offs. When I got the Tamron 24-70 2.8 G2, I considered selling the Sigma 24-105. This test validates my decision not to sell it.
almeich ·
I would buy a lens based on a test (if the tester is reliable and reputable) provided I like the looks and feeling of the lens. Just like I would buy a car.
If I had a lens and considered selling it, no test in the world would matter. Only my guts feeling.
obican ·
Roger Cicala (from lensrentals.com) says Sigma 24-105DG OS HSM ART gives you 5x zoom lens performance even though it is much closer to 4x.
Roger Cicala ·
4.375 and I rounded up. See time compression above. I’m getting round up compression too.
obican ·
Roger Cicala (from lensrentals.com) says Sigma 24-105DG OS HSM ART gives you 5x zoom lens performance even though it is much closer to 4x.
Roger Cicala ·
4.375 and I rounded up. See time compression above. I'm getting round up compression too.
Athanasius Kirchner ·
I know that you’ve been late in posting this article, but, 2012? Damn Roger, that’s a heck of a long time to have kept this thing under wraps. It’s even more fascinating that all these shiny new graphs were being experimented with so long ago 😀
Seriously, thanks for the article. That behavior upon stopping down is ridiculous, it goes from meh to Art in one stop!
Roger Cicala ·
Well, you know at my age, you get time compression. I’ve been referring to things that happened in the 90s as ‘about 5 years ago’ for a while now. I guess I’m getting worse, because last weeks article was ‘about 5 years ago’.
Brandon Dube ·
You know I was born in the 90s right? 😉
Roger Cicala ·
Yeah. About 5 years ago. . . . . . 🙂
Athanasius Kirchner ·
I know that you've been late in posting this article, but, 2012? Damn Roger, that's a heck of a long time to have kept this thing under wraps. It's even more fascinating that all these shiny new graphs were being experimented with so long ago :D
Seriously, thanks for the article. That behavior upon stopping down is ridiculous, it goes from meh to Art in one stop!
Roger Cicala ·
Well, you know at my age, you get time compression. I've been referring to things that happened in the 90s as 'about 5 years ago' for a while now. I guess I'm getting worse, because last weeks article was 'about 5 years ago'.
Brandon Dube ·
You know I was born in the 90s right? ;-)
Roger Cicala ·
Yeah. About 5 years ago. . . . . . :-)
Tim Cooper ·
What I really want is a nominal f/5.6 zoom that I can shoot at f/8 all the time. Maybe we’re getting closer to that.
Tim Cooper ·
What I really want is a nominal f/5.6 zoom that I can shoot at f/8 all the time. Maybe we're getting closer to that.
Andre Yew ·
Roger, sorry to be That Guy ™, but as a control reference, do you have f/5.6 MTFs for the Nikon or Canon lenses? Maybe 4-5x zooms are all magical 1 stop down (probably not), or the Sigma is an amazing design. Thanks for posting this: it looks like an amazing lens.
Roger Cicala ·
I don’t have Nikon stop-downs because the aperture system makes it very difficult to do stop-down bench testing. But I have the Canon 24-105 I and II and a couple of hundred others. This is SPECTACULAR stop-down performance. The Canon is not close.
Andre Yew ·
Roger, sorry to be That Guy (tm), but as a control reference, do you have f/5.6 MTFs for the Nikon or Canon lenses? Maybe 4-5x zooms are all magical 1 stop down (probably not), or the Sigma is an amazing design. Thanks for posting this: it looks like an amazing lens.
Roger Cicala ·
I don't have Nikon stop-downs because the aperture system makes it very difficult to do stop-down bench testing. But I have the Canon 24-105 I and II and a couple of hundred others. This is SPECTACULAR stop-down performance. The Canon is not close.
Adam Brown ·
Curious to see your testing of the Sony 24-105/4… which may actually be the best 24-105/4 ever made..
Zach Sutton Photography ·
Looking at the backend of the blog, it looks like your request will be filled sometime in the next week 🙂
Adam Brown ·
This was my review of the Sony 24-105..
http://enthusiastphotoblog.com/2018/01/28/sony-24-105mm-f-4-g-lens-review/
I took a lot of heat for complaining about the vignetting at 24mm, though I did find it otherwise to be a simply spectacular lens.
Roger Cicala ·
Adam, I agree with you, as long as you stay at f/4. But the Sony has some weirdness stopped down.
Adam Brown ·
hmm, I’ll look forward to your testing report, which will be far more scientific than my naked eye. This isn’t a lens I would typically stop down too much, so probably not a big issue for me. On the other hand, I’m working on my review of the Sony 12-24 now, and I’m astonished at how sharp it is wide open for such a wide angle lens, but I notice that diffraction (or something) kicks in very early, F4-5.6 may be the sharpest it gets. We are getting pretty spoiled — virtually every modern lens is center-sharp wide-open nowadays.
almeich ·
Having waited so long, a few more days is quite OK with me. Thanks in advance.
Oleg ·
You won’t be enjoying taking pictures with it if it turns out to be not the best ever made?
Adam Brown ·
lol, has nothing to do with my enjoyment. Just curious if objective testing backs up my own impressions.
Oleg ·
That’s great 🙂 Could you please post a link to your review and samples?
Adam Brown ·
See above.
Adam Brown ·
Curious to see your testing of the Sony 24-105/4... which may actually be the best 24-105/4 ever made..
Zach Sutton Photography ·
Looking at the backend of the blog, it looks like your request will be filled sometime in the next week :-)
Adam Brown ·
This was my review of the Sony 24-105..
http://enthusiastphotoblog....
I took a lot of heat for complaining about the vignetting at 24mm, though I did find it otherwise to be a simply spectacular lens.
Roger Cicala ·
Adam, I agree with you, as long as you stay at f/4. But the Sony has some weirdness stopped down.
Adam Brown ·
hmm, I'll look forward to your testing report, which will be far more scientific than my naked eye. This isn't a lens I would typically stop down too much, so probably not a big issue for me. On the other hand, I'm working on my review of the Sony 12-24 now, and I'm astonished at how sharp it is wide open for such a wide angle lens, but I notice that diffraction (or something) kicks in very early, F4-5.6 may be the sharpest it gets. We are getting pretty spoiled -- virtually every modern lens is center-sharp wide-open nowadays.
GuyWith ·
I’ve always regretted selling our Honda Odyssey minivan. With the back seats folded down that thing held a TON of gear and never broke down. What was I thinking?
GuyWith ·
I've always regretted selling our Honda Odyssey minivan. With the back seats folded down that thing held a TON of gear and never broke down. What was I thinking?
JeffB ·
I was hoping to find a review of the Sony Zeiss A 24-70mm f/2.8 somewhere here, and nearly thought I had until I read f4. Any chance that the f2.8 will be reviewed/ Especially as they’ve updated with a Mark II edition.
Roger Cicala ·
No review, but I’ll share the MTF data from the original version.
https://uploads.disquscdn.com/images/285a7a44478884458d401c4b9d3c1edde87d8dce1808146ff4da53f7eeb519c5.png https://uploads.disquscdn.com/images/73dddd1b01b0a54315c742b40f340b6601ddb49206874e492a013fe1a39a53e7.png https://uploads.disquscdn.com/images/18d8646b2c4829feba087b725b6aaa1cfa88e2825b96ebb15fce0a30dec2b767.png
JeffB ·
Thank you!
JeffB ·
I was hoping to find a review of the Sony Zeiss A 24-70mm f/2.8 somewhere here, and nearly thought I had until I read f4. Any chance that the f2.8 will be reviewed? Especially as they've updated with a Mark II edition.
Roger Cicala ·
No review, but I'll share the MTF data from the original version.
https://uploads.disquscdn.c... https://uploads.disquscdn.c... https://uploads.disquscdn.c...
Jerry Sarmento ·
Did you look at f8? Just wondering if it gets better, same or worse?
Roger Cicala ·
Jerry, I don’t test past f5.6.
cb5107 ·
Understandable for sure. We do love what you are able to put out.
Roger Cicala ·
Jerry, I don't test past f5.6. There's just a limit on how much time I can spend doing extras for these tests - for our in-house purposes all I need are wide-open tests. A set of 10 of theses lenses is already almost two days of MTF time for testing. A full set of stop-downs would double that; another stop . . . . . well at $150 an hour just for MTF bench time, it adds up fast.
Lee ·
Some kind of weirdness going on with the stop-down tests? The 70mm f/4 chart looks significantly different from the one we see earlier in the Nikon and Canon comparisons. The 24/4 and 105/4 charts are different too, but negligibly. Were these done at a different time with a different batch?
Roger Cicala ·
The stop-down tests are single copies at both apertures, so not going to be the same as the average of 10 in the overall tests.
?ukasz Moszczy?ski ·
Roger, it’s not a April Fools’ Day… Such an improve after one stop it’s simply impossible.
Here’s one of the proofs that it’s a mistake or a lie:
https://www.the-digital-picture.com/Reviews/ISO-12233-Sample-Crops.aspx?Lens=787&Camera=453&Sample=0&FLI=4&API=3&LensComp=918&CameraComp=453&SampleComp=0&FLIComp=4&APIComp=2
As you can see, Canon 24-70 2.8 II is far better then Sigma (at 70 mm, f/5.6).
If you look at Sigma MTF chart (above; 70 mm, f/5.6) vs Canon (70 mm, f/5.6):
https://media.the-digital-picture.com/Images/Lens-Tests/MTF/Canon-EF-24-70mm-f-2.8-L-II-USM-Lens/AVG-70mm-f56.png
you’ll understand that you’re wrong.
Roger, I hope it’s just a prank and you did not do it for the money.
Roger Cicala ·
Lukasz, that was my first thought, too, so I had the tech repeat them on a different copy and they were the same. But Tinus has a good point — we set the lens to the aperture but don’t measure it. So when I do it I’ll double check that there’s not some weirdness in that, too.
BTW – I’m never going to consider pictures taken with one copy as a “proof”. I spend too much time furnishing various reviewers, including Brian at TDP, second and third copies that I’ve checked to repeat tests for soft corners.
Munchma Quchi ·
Maybe Sigma snuck in some VW Clean Diesel defeat device like software and the lens knows it’s on OLAF?
Only one way to be certain – conduct your MTF tests in a moving car at highway speeds.
PS – thanks RC – good to see some traditional lens testing here with all of the caveats.
?ukasz Moszczy?ski ·
Roger, so far, if you haven’t had tested 10 copies, you would have taken the lens which had average performance. I assume you did the same in this case, so I will not believe that suddenly the lens with average/medium performance after stopped down (from f/4 to f/5.6), turned out to be the eighth miracle of the world.
BTW, in both reviews – yours and Brian, results for f/5.6 are based on only one copy.
Brian’s results (he used the same camera body to test Canon and Sigma) clearly show Canon’s superiority over Sigma.
Perhaps you’ll take my words too harsh (trust me it’s not my intention), but I just can not believe that the results for f/5.6 do not contain any error.
For me results aren’t shocking – results are simply wrong.
Roger Cicala ·
Could be. I was shocked myself. Give me a couple of days and I’ll run a few more. One of the reasons I do this is because I appreciate feedback. There’s no peer review journal of MTF.
?ukasz Moszczy?ski ·
Roger, I appreciate your work very much, I’ve learned a lot from your articles, and I believe that you will come back soon with information about the reason for, obviously unintentional, mistake.
Roger Cicala ·
Lukasz, there was, indeed an error and I’ve tracked it down. The source is me trying to multi-task, which I should know better than to do, I am the world’s worst at multi-tasking.
The tech running the MTFs had been doing crop sensor lenses before the stop down tests on the Sigma. To switch to full-frame he needed to adjust the size of the field size. He did it in the labeling, but not on the bench and a flaw in our software doesn’t double check that; so it stretched the graph to fill the full-field. Basically what should have been only 14mm data was stretched out to 20mm. The center was accurate, but the outer 1/3 of the MTF was missing. Instead of stopping what I was doing an rechecking everything myself, I said ‘rerun it’ and when it came back the same, accepted it.
I will have the graphs redone as soon as possible — but will not multitask to do it so it will be a couple of days.
I screwed up. But that’s why I believe so strongly in being transparent in methodology. It allows people to go ‘wait that looks wrong’ and get things corrected. All of us are smarter than any of us.
Roger
Munchma Quchi ·
If only our politicians were as honest and transparent as you Roger.
OK well maybe Jerry Brown.
May I be the first to nominate the ticket of BROWN-CICALA 2020 !!! https://uploads.disquscdn.com/images/298713b9a4bd5665c3989eac527bb32f1907b8ceb8d9ac9810db05f78350858b.png
Munchma Quchi ·
Make your own Brown – Cicala 2020 Political Sticker here –
https://www.buildasign.com/PowerDesign.aspx?T=4B465664586A34593157356C31734C7633776F556F673D3D&CID=1258
https://uploads.disquscdn.com/images/7363f66d80425be1296aaf8cf87aa97348c275574c755bdf530439eaba521977.png
Munchma Quchi ·
https://uploads.disquscdn.com/images/703e6a49b26152d3134644b61891b775b6e7fb74f19643edb1dd9ed2e21522a6.png
Roger Cicala ·
You got the names backwards 🙂
Also, a Brown Cicala sounds like either an insect, or some kind of mixed drink.
Matt Krull ·
Neither of which I want to ingest.
Michael Clark ·
Well, you know, some insects only make appearances at very regular intervals every few years…
?ukasz Moszczy?ski ·
Roger, thank you for your inquisitiveness.
Andre Yew ·
Roger, glad to hear the mystery is solved, and for your checking up on the results! I assume the software will be fixed as well, so this won’t happen again? A lot of people could learn from your transparency and honesty!
Roger Cicala ·
Sigh. The software has been ‘being fixed’ for many months. This is the worst time; or web based programming is usable but still buggy. Our Matlab based programming isn’t being updated as much because we’re focusing on the new programming. Which will be ready next month. It has been ‘ready next month’ every month since November. Because programming. 🙁
Michael Clark ·
Who is going to break the news to Sigma, who has been quoting the fourth from the last paragraph all over the interwebs in their ads for the 24-105/4 ART?
Roger Cicala ·
Well, it isn’t quite as spectacular, but it’s still the best f5.6 I’ve ever seen. The others f4 zooms improve very little stopped down.
Roger Cicala ·
Well, it isn't quite as spectacular, but it's still the best f5.6 I've ever seen. The others f4 zooms improve very little stopped down.
Munchma Quchi ·
Luckass,
Although you were right, I’ve learned from you also – both good and bad.
Good – be skeptical – be persistent.
Bad – don’t be an ass.
?ukasz Moszczy?ski ·
I am glad that you could learn something from me. Well… Even if finally it’s only 50% of gladness 😉
PS “Luckass” – great! 😀
Munchma Quchi ·
Good to see you have a sense of humor too.
Doug McEwen ·
Lukasz: Wow, that is way too harsh. Surely the better explanation is that although sample variation looks “quite good” wide open per Roger’s measurements above, sample variation becomes a much larger factor at f/5.6, where we know that at least one copy (the one tested above) has incredibly good MTF, and another copy (the one tested by Bryon at TDP) was fairly ordinary – roughly the same as the Canon 24-105. No need to make accusations.
Michael Clark ·
Except now we know Roger’s f/5.6 test was for an APS-C sized field instead of a FF sized field.
Łukasz Moszczyński ·
Roger, it's not a April Fools' Day... Such an improvement after one stop it's simply impossible.
Here's one of the proofs that it's a mistake or a lie:
https://www.the-digital-pic...
As you can see, Canon 24-70 2.8 II is far better then Sigma (at 70 mm, f/5.6).
If you look at Sigma MTF chart (above; 70 mm, f/5.6) vs Canon (70 mm, f/5.6):
https://media.the-digital-p...
you'll understand that you're wrong.
Roger, I hope it's just a prank and you did not do it for the money.
So, guess what did I learn today...
Roger Cicala ·
Lukasz, that was my first thought, too, so I had the tech repeat them on a different copy and they were the same. But Tinus has a good point -- we set the lens to the aperture but don't measure it. So when I do it I'll double check that there's not some weirdness in that, too.
BTW - I'm never going to consider pictures taken with one copy as a "proof". I spend too much time furnishing various reviewers, including Brian at TDP, second and third copies that I've checked to repeat tests for soft corners. But I apply the same rule to my own tests. I don't have time to repeat 10 copies at stop down, so even repeated, we are dealing with one copy here which isn't really scientific. I'll redo a couple of more this time and see what we see since the results are so shocking. But there just isn't time to start doing 10 copy stop-downs.
Łukasz Moszczyński ·
Roger, so far, if you haven't had tested 10 copies, you would have taken the lens which had average performance. I assume you did the same in this case, so I will not believe that suddenly the lens with average/medium performance after stopped down (from f/4 to f/5.6), turned out to be the eighth miracle of the world.
BTW, in both reviews - yours and Brian, results for f/5.6 are based on only one copy.
Brian's results (he used the same camera body to test Canon and Sigma) clearly show Canon's superiority over Sigma.
Perhaps you'll take my words too harsh (trust me it's not my intention), but I just can not believe that the results for f/5.6 do not contain any error.
For me results aren't shocking - results are simply wrong.
Roger Cicala ·
Could be. I was shocked myself. Give me a couple of days and I'll run a few more. One of the reasons I do this is because I appreciate feedback. There's no peer review journal of MTF. It would not be the first or the last time I've made a mistake if it is. That's what happens when you try to herd cats with a group of smart people working on stuff no one else is doing.
We put very heavy emphasis on being very open in what we do. If I wanted to lie I'd make up some secret formulae and say they were proprietary. Anyone who has an optical bench should be able to reproduce what we do here; we lay our methodology out pretty plainly. To date, at least, no one seems interested in that.
I admire Brian's work very much; he is a friend and we discuss methods regularly - he is meticulous. That's why my MTF graphs are repeated on his site.
Łukasz Moszczyński ·
Roger, I appreciate your work very much, I've learned a lot from your articles, and I believe that you will come back soon with information about the reason for, obviously unintentional, mistake.
Roger Cicala ·
Lukasz, there was, indeed an error and I've tracked it down. The source is me trying to multi-task, which I should know better than to do, I am the world's worst at multi-tasking.
The tech running the MTFs had been doing crop sensor lenses before the stop down tests on the Sigma. To switch to full-frame he needed to adjust the size of the field size. He did it in the labeling, but not on the bench and a flaw in our software doesn't double check that; so it stretched the graph to fill the full-field. Basically what should have been only 14mm data was stretched out to 20mm. The center was accurate, but the outer 1/3 of the MTF was missing. Instead of stopping what I was doing an rechecking everything myself, I said 'rerun it' and when it came back the same, accepted it.
I will have the graphs redone as soon as possible -- but will not multitask to do it so it will be a couple of days.
I screwed up. But that's why I believe so strongly in being transparent in methodology. It allows people to go 'wait that looks wrong' and get things corrected. All of us are smarter than any of us.
Roger
Łukasz Moszczyński ·
Roger, thank you for your inquisitiveness.
Andre Yew ·
Roger, glad to hear the mystery is solved, and for your checking up on the results! I assume the software will be fixed as well, so this won't happen again? A lot of people could learn from your transparency and honesty!
Roger Cicala ·
Sigh. The software has been 'being fixed' for many months. This is the worst time; our web based programming is usable but still buggy. Our Matlab based programming isn't being updated as much because we're focusing on the new programming. Which will be ready next month. It has been 'ready next month' every month since November. Because programming. :-(
Doug McEwen ·
Lukasz: Wow, that is way too harsh. Surely the better explanation is that although sample variation looks "quite good" wide open per Roger's measurements above, sample variation becomes a much larger factor at f/5.6, where we know that at least one copy (the one tested above) has incredibly good MTF, and another copy (the one tested by Bryan at TDP) was fairly ordinary - roughly the same as the Canon 24-105. No need to make accusations.
Michael Clark ·
Except now we know Roger's f/5.6 test was for an APS-C sized field instead of a FF sized field.
TinusVerdino ·
I would think of actually measuring the aperture to so whether Sigma isn’t cheating and is actually stopping down to F8 😉
TinusVerdino ·
I would think of actually measuring the aperture to so whether Sigma isn't cheating and is actually stopping down to F8 ;)
Edward Little ·
I recently picked up a Nikon 24-120mm over a Sigma 24-105mm Art as a travel zoom after a very extended period of umming and ahhing. So when I saw the title of this blog I admit to feeling some heart palpitations because I was fully expecting to discover that I made the wrong choice. Having now read it, I’m glad that I can breathe a sigh of relief.
Edward Little ·
I recently picked up a Nikon 24-120mm over a Sigma 24-105mm Art as a travel zoom after a very extended period of umming and ahhing. So when I saw the title of this blog I admit to feeling some heart palpitations because I was fully expecting to discover that I made the wrong choice. Having now read it, I'm glad that I can breathe a sigh of relief.
Yugo Nakai ·
Great data and analysis as always, Roger! I was curious how this compares to 24-70 f/4 lenses, and a quick glance at the Sony and Canon versions suggests this Sigma Art 24-105 f/4 stands up in comparison:
https://www.lensrentals.com/blog/2016/06/sony-fe-16-35-f4-sony-fe-24-70mm-f4-zoom-mtf-and-variance/
Yugo Nakai ·
Great data and analysis as always, Roger! I was curious how this compares to 24-70 f/4 lenses, and a quick glance at the Sony and Canon versions suggests this Sigma Art 24-105 f/4 stands up in comparison:
https://www.lensrentals.com...
Łukasz Moszczyński ·
I am glad that you could learn something from me. Well... even if finally it's only 50% of gladness ;)
PS "Luckass" - great! :D
Roger Cicala ·
You got the names backwards :-)
Also, a Brown Cicala sounds like either an insect, or some kind of mixed drink.
Matt K ·
Neither of which I want to ingest.
Michael Clark ·
Well, you know, some insects only make appearances at very regular intervals every few years...
Steve Oakley ·
Show me 20-100 2.8 or better yet 1.8 and then I’ll want one and be excited. Just bought the sigma 50-100 1.8 and quite happy with it.
Steve Oakley ·
Show me 20-100 2.8 or better yet 1.8 and then I'll want one and be excited. Just bought the sigma 50-100 1.8 and quite happy with it.
dyna ·
Curious on your thoughts concerning Tamron’s 24-70 G2. I know I’m biased but Sigma gets an awful lot of love over here.
Roger Cicala ·
Dyna, actually Sigma puts out a lot of lenses. There’s lots of Sigma and Sony releases, and therefore lots of Sigma and Sony tests.
The original Tamron 24-70 was a really good lens, comparable to all the others. I’m not retesting it because the changes aren’t in the optics, they’re in things I don’t measure, like better focusing and build. I would certainly give it consideration as a comparable-to-the-others at perhaps a better price lens.
Tamron is making some great and unique lenses, like their f/1.8 primes. Really love those. The 150-600s also seem excellent, but I can’t test that long of a lens, so again can’t review them here. They seem to be making a lot of lenses that wear other manufacturer’s badges, too, and those are generally excellent.
dyna ·
One point of clarification concerning the SP 24-70 G2 vs the preceding model: the optical array is essentially the same but both the glass and the coatings were all new formulae. Hence the reviews showing much higher transmission and resolution throughout the frame at all focal lengths (also my personal experience) when the two were compared side by side. I can’t comment on the OEM, of course but it would have been informative, to say the least, to revisit the Sigma ART 24-70 2.8 when the Tamron SP 24-70 G2 was released. I respect it’s your turf, though 🙂 And time is ever too short a thing 🙂
Roger Cicala ·
I heard new coatings, so I believe the transmission improvement. In checking I haven’t seen ‘new glass’ other than internet conversation based on a Tamron reps comments, and reps don’t know a damned thing – I get emails from reps every week asking what their company is doing. Changing glass means changing the optical formula and a complete redesign, so I don’t think that was so. But if we get time I may run a few to confirm.
Roger Cicala ·
Dyna, actually Sigma puts out a lot of lenses. There's lots of Sigma and Sony releases, and therefore lots of Sigma and Sony tests.
The original Tamron 24-70 was a really good lens, comparable to all the others. I'm not retesting it because the changes aren't in the optics, they're in things I don't measure, like better focusing and build. I would certainly give it consideration as a comparable-to-the-others at perhaps a better price lens.
Tamron is making some great and unique lenses, like their f/1.8 primes. Really love those. The 150-600s also seem excellent, but I can't test that long of a lens, so again can't review them here. They seem to be making a lot of lenses that wear other manufacturer's badges, too, and those are generally excellent.
David B ·
Roger can you throw Sony 24-105g into the mix? Sigma can go on mc11 adapter for comparison.
Roger Cicala ·
Should be up on Monday. It’s done, but the editor had something else in front of it.
Roger Cicala ·
Should be up on Monday. It's done, but the editor had something else in front of it.
GuyWith ·
Data point re: Bokeh and f/4 zooms…. I shoot a lot of closeups of various small objects in my work for businesses but I always try to include background as well. So even though I often shoot at f/5.6-8, background bokeh is VERY important to me no matter what lens.
GuyWith ·
Data point re: Bokeh and f/4 zooms.... I shoot a lot of closeups of various small objects in my work for businesses but I always try to include background as well. So even though I often shoot at f/5.6-8, background bokeh is VERY important to me no matter what lens.
Devil'sAdvocate ·
Great article, but perhaps your proof reader was having an off day when they should have written:
“Otherwise, this is a 24-105mm f/4 image stabilized lens that
as good or better optically asis optically as good as or better than any of the others I’ve tested and [is also] available at a lower price.”Chris Jankowski ·
Knowing how useful are the F4 5X lenses, why is there only one that is truly 5X – F4 24-120 from Nikon? No other manufacturer has one, I believe. One would have thought that this would be a nice point of differentiation for third party lens manufacturers.
Nobody Knows ·
I had the Nikon for a very short while Chris I found it to be quite disappointing , perhaps a step to far regarding focal range ?
Chris Jankowski ·
Knowing how useful are the F4 5X lenses, why is there only one that is truly 5X - F4 24-120 from Nikon? No other manufacturer has one, I believe. One would have thought that this would be a nice point of differentiation for third party lens manufacturers.
Nobody Knows ·
Thank you for all the time and effort you put into these tests, even though as a rule we photographers are professional whiners and nitpickers it is genuinely much appreciated
Tom Burke ·
Wondering how the Sigma would compare with the Canon 24-105 L Mk 1. There wasn’t enough improvement in the Mk 2 (according to the reviews – I have never tried it) to make me upgrade. But the Sigma is certainly cheaper than the Canon Mk 2, and probably better, so I’m pondering….
Tom Burke ·
Wondering how the Sigma would compare with the Canon 24-105 L Mk 1. There wasn't enough improvement in the Mk 2 (according to the reviews - I have never tried it) to make me upgrade. But the Sigma is certainly cheaper than the Canon Mk 2, and probably better, so I'm pondering....
Chik Sum ·
Hi Roger, I am personally more interested in a few lens mtf variance map through typical focal lengths, I remember sometime before you showed some 70-200mm lens variation, but How does these 4x zoom goes in that department is interesting
YS ·
Hi Roger, I am personally more interested in a few lens mtf variance map through typical focal lengths, I remember sometime before you showed some 70-200mm lens variation, but How does these 4x zoom goes in that department is interesting
Andrej Belic ·
i like your style of writing
Matt ·
Checks back again. Still no update to this post. Still no post on the Sony 24-105. Gets text from wife saying my lensrental lens arrived. Checks time, still can’t go home from work. I feel so teased.
Zach Sutton Photography ·
Hahah, Sony 24-105mm article tomorrow morning. I promise. 🙂
Matt ·
Checks back again. Still no update to this post. Still no post on the Sony 24-105. Gets text from wife saying my lensrental lens arrived. Checks time, still can't go home from work. I feel so teased.
Zach Sutton Photography ·
Hahah, Sony 24-105mm article tomorrow morning. I promise. :-)
SolJuJo ·
“So I’m going to take this section down until I have retested it carefully. I expect to have the stopdowns back by the end of the week. ”
Hrrrmmmh.
There’s an end of every week, and it’s always correct 😀
Sorry Roger, you woke my curiosity (all your fault…) and I don’t get it to sleep so easily again. What happens when stopping down? You managed to stop the Sony down and that’s a younger lens – you will talk also the Sigma into stopping down.
I’m sure.
Has to be…
Roger Cicala ·
Just put them up. I took a day off Friday. 🙂
SolJuJo ·
Lucky you. Being “da man” as you are, I suspect it was a highly deserved and too long awaited Friday. And the lens would not really got worse, not on Friday or any other end of any other week.
Thanks a lot!
SolJuJo ·
"So I’m going to take this section down until I have retested it carefully. I expect to have the stopdowns back by the end of the week. "
Hrrrmmmh.
There's an end of every week, and it's always correct :D
Sorry Roger, you woke my curiosity (all your fault...) and I don't get it to sleep so easily again. What happens when stopping down? You managed to stop the Sony down and that's a younger lens - you will talk also the Sigma into stopping down.
I'm sure.
Has to be...
Roger Cicala ·
Just put them up. I took a day off Friday. :-)
SolJuJo ·
Lucky you. Being "da man" as you are, I suspect it was a highly deserved and too long awaited Friday. And the lens would not really got worse, not on Friday or any other end of any other week.
Thanks a lot!
Roger Cicala ·
I heard new coatings, so I believe the transmission improvement. In checking I haven't seen 'new glass' other than internet conversation based on a Tamron reps comments, and reps don't know a damned thing - I get emails from reps every week asking what their company is doing. Changing glass means changing the optical formula and a complete redesign, so I don't think that was so. But if we get time I may run a few to confirm.
Jaanish Fotografie ·
Great post! The photography bokeh is nice though.
Tom ·
I rented a 24-105 Sigma Art from you in the fall of 2017. Went to Utah with it on a 800E. Came home & bought one!
Mark Rustad ·
…and then along came the Sony 24-105mm f4. Just as you thought you had rinsed all the soap from your hands!
Mark Rustad ·
...and then along came the Sony 24-105mm f4. Just as you thought you had rinsed all the soap from your hands!
Nemo Niemann ·
I love your dry humor: And yes, I realize I’ve just said ‘this is the hottest Minivan on the market’ but hey, if you need a minivan, you might as well get the hottest minivan. Maybe paint some flames on the side, too.
Also: “My Other Lens is a Ferrari”
Keep up the insightful and “non-dry” writing. It makes wading the technical-but-useful reviews oh so much more palatable!
Nemo Niemann ·
I love your dry humor: And yes, I realize I’ve just said ‘this is the hottest Minivan on the market’ but hey, if you need a minivan, you might as well get the hottest minivan. Maybe paint some flames on the side, too.
Also: “My Other Lens is a Ferrari”
Keep up the insightful and "non-dry" writing. It makes wading the technical-but-useful reviews oh so much more palatable!
Dana ·
Since this is a difficult range lens to make, what would be wrong with a 35-105 or a 35-120?
Eta76 ·
2019, and now there is a 35-150mm Tamron f/2.8-4
Miroslav Kví?ala ·
Really, nice review 🙂 I have this lens. Maybe, it is not sexy, but very useful in many situations.
Miroslav Kvíčala ·
Really, nice review :) I have this lens. Maybe, it is not sexy, but very useful in many situations.
Justin ·
Roger, you’re hilarious. “hottest minivan” lol
NoGodsNoBosses ·
Roger, you're hilarious. "hottest minivan" lol
Mustafa Rony Zeno ·
I’m curious about the “parfocalness” of this lens. Have you guys done any tests to see the amount of shifting of focus throughout the zoom range?
Mustafa Rony Zeno ·
I'm curious about the "parfocalness" of this lens. Have you guys done any tests to see the amount of shifting of focus throughout the zoom range?