Welcome to our community

Be a part of something great, join today!

  • Hey all, just changed over the backend after 15 years I figured time to give it a bit of an update, its probably gonna be a bit weird for most of you and i am sure there is a few bugs to work out but it should kinda work the same as before... hopefully :)

Testing Zeiss Master Primes vs Ultra Primes

Pawel Achtel

Banned
Joined
Oct 12, 2007
Messages
3,648
Reaction score
0
Points
0
Location
Tasmania
Website
www.achtel.com
Today I had a great evening at Arri Australia projecting and evaluating various lenses that I intend to put on my Red One and later on Epic.

My Evaluation Criteria
The assumption was that, in order to resolve for Mysterium sensor, a clear and contrasty image of ~70lp/mm should be obtained across the image plane. Accordingly, my main criteria for glass selection was to achieve ~70% MTF at 70lp/mm. To aid my estimation, I assumed that the 70% modulation corresponds to roughly 5-10%MTF (barely visible) at ~200lp/mm. Other than that, the testing was very "unscientific" and mainly aimed at giving me a ball-park guidance.

Wide Angle
We projected 16mm MP and 16mm UP. The difference in the 60% centre section was very small, but noticable. Both lenses resolved 70lp/mm nicely in the centre. However, at the edges the 16mm UP is soft - very soft. Essentially, if you shooting 3k widndowed, the UP will be OK, but at full sensor coverage expect significant bluring and CA towards the edges of the frame and corners are even worse strugling with resolving even 30lp/mm. Master Prime had some softness in the very corners too, but the edges were as crisp as it gets.
My opinion is that in wide angle department Master Prime is an absolute minimum glass to have on a 4k (or 5k) chip, no ifs or buts. In the corners, the limitation is still in the glass and not in a 4k sensor, not even in a 3k sensor! But anywhere else, including edges, the 4k sensor would limit the final image resolution.


Medium Angles
We projected 35mm MP and 32mm UP. There was less difference between UP and MP here, however I still decided to put 35mm Master Prime in the shopping basket in favour of an equivalent UP. Not as prominent as at 16mm wide angle but, after careful consideration, I concluded that the MP is worth the extra cost as the difference in corner resolution was still significant. What I mean significant is that it is clearly a limiting factor over the CMOS resolving power. At 3k crop area both lenses out-resolved the sensor and produced 70lp/mm with high contrast and I could not see any significant difference in their performance in this region. For budget concious, going UP in those angles (~35mm focal length) is tempting, specially if shooting 1:1.85 or 1:2.35 aspect ratios. I decided to "future proof" for Epic and selected a MP again.

Long Lenses
We projected 75mm MP and 80mm UP. I was hard pressed to tell them apart except for the very corners and even that was marginal. Both performed superbly resolving far beyond what Mysterium is capable of.
We also put 180mm UP on the projector. Again, beautiful lens: crisp corner-to-corner and out-resolving Mysterium sensor comfortably.

Conclusions
I am taking delivery of 14mm MP (wider than 16mm tested) and this is a must-have lens at those angles. If you think any lesser glass would resolve 4k at super wide angles, you are kidding yourself! Master Prime barely achieves this and it is miles apart from Ultra Prime.

If you are aiming at Red One's or Epic's full raster, medium angles of about 35mm focal length are still in Master Prime territory. The difference is on the edges and corners only, but the difference is clearly visible. Border line, but enough to swing me into selecting Master Prime.

At longer focal lengths of ~75mm, you will save heaps of money by going Ultra Primes. They are razor sharp corner-to-corner, edge-to-edge and, in my opinion, there is absolutely no justification to go Master Prime. Mysterium chip resolving power will be a limiting factor here, certainly not the glass.

It was quick and rough "sanity check", but I hope some of you guys will find the above observations useful.

It was certainly good fun playing with all this glass and I would like to thank Rey and Stefan of Arri Australia for their kind invitation and assistance.
 
I have to cool you a bit as the MP lenses are concern.

Look on my test (vignetting) of 65mm MP I did last month here:
http://www.reduser.net/forum/showpost.php?p=191978&postcount=3

MPs have vignetting to the point that I can’t take it out with standard vignetting correction software.
I had to do custom map and put it as a corrective layer, losing two stops of DR.

Ask ARRI Australia what they think, why we have this vignetting.

Also check on my 16 mm, 8mm, and 65mm, LW zoom, I was getting bit better results on the projector that you did.

Links here,
On the projector test:

UP 8R T2.8
http://www.reduser.net/forum/showpost.php?p=26784&postcount=27
http://www.reduser.net/forum/showthread.php?t=1381&highlight=zeiss

65mm MP
http://www.reduser.net/forum/showthread.php?t=1475&highlight=zeiss

LW Zoom LWZ-1 15.5 – 45mm T2.6
http://www.reduser.net/forum/showthread.php?t=5585&highlight=zeiss

What brand of the projector did you use?

And on the camera RED test:
65mm
http://www.reduser.net/forum/showthread.php?t=11432&highlight=zeiss
http://www.reduser.net/forum/showpost.php?p=205364&postcount=8


My advice for testing the lenses, it is good to pre-test the lenses on good quality projector, but nothing will replace the on the camera test, with good chart, evenly lit (use dispersed light) and underexpose one or two stops.
 
  • Thread starter
  • Banned
  • #3
Ask ARRI Australia what they think, why we have this vignetting.
...
What brand of the projector did you use?

The lenses that we projected were as flat as they get. I could not see any vignetting in the S35 area, even on the 16mm open wide and even in the very corners outside of Mysterium sensor active pixel array. 2 stops falloff that you observed is massive. It could be perhaps explained in an 8mm rectiliner fully opened, but certainly on a 65mm it is a mystery. It would be good to dig to the bottom of it because I couldn't see any evidence of vignetting on the projector. It was perfectly flat at all focal lengths we tried: 16mm, 35mm and 75mm Master Primes and likewise on equivalent Ultra Primes. And, I'm alergic to vignetting :blink:

What is the vignetting of the 65m MP on film, then? If it is a problem of the lens, it would show up on film just as much as on a CMOS sensor. This makes me think that the vignetting you observed could be something to do with the angle at which the image is projected on the sensor. I guess you eliminated the obvious, such as your mattebox and adapter ring :biggrin:

Not sure about the brand of the projector they use at Arri.
 
Pawel, on the projector, the test is bit different that on the film or on the sensor.

I couldn't see any evidence of vignetting on the projector. It was perfectly flat at all focal lengths we tried: 16mm, 35mm and 75mm Master Primes and likewise on equivalent Ultra Primes..

And how could you see vignetting if the background is black?

Projector is producing light so it is good for lp/mm test and CA test.
As to vignetting, the only test you can do is on the film or on the sensor.
Projector picture could be measured for vignetting with the light meter but again it is black background we are dealing with on the projector test.

I posted the picture of my setup, always take a picture of the test setup so people can see.
http://www.reduser.net/forum/showpost.php?p=191917&postcount=2

Sometimes there is something obvious that some other member of this board can see and you missed it.
I didn’t use anything in front of the lenses.
We tested two of them as well to make sure that we are not dealing with the defective lenses or something.
 
  • Thread starter
  • Banned
  • #5
Thanks Andrew,

I am not discounting your findings. I find them intriguing to say the least. I'd like to dig to the bottom of it because it does not seem right for a 65mm lens to show 2 stops of vignetting. I have not seen this even in a $100 lens.

I agree that projection is not the best way to evaluate vignetting, but 2 stops should be noticable. The chart had a fair amount of white spots on it anyway.

Have you seen Evin Grant's thread and frame grabs?

http://www.reduser.net/forum/showthread.php?t=7593

I can't see much vignetting there, which makes it even more mysterious. Anyone else would like to chime in?
 
Pawel, the tricky thing is to evaluate the vignetting on the live shot.
I didn`t see any vignetting on MP till I actually shot this chart.
If you shot the white smooth surface underexposed two stops, then you see it right away.
Yes, it is mysterious, and I was warned of possibility of vignetting on MP two years ago by some experts.
maybe that is why they don't call it Digi MPs since MPs are not suitable for digital sensors.
 
Digital lenses

Digital lenses

What is the vignetting of the 65m MP on film, then? If it is a problem of the lens, it would show up on film just as much as on a CMOS sensor. This makes me think that the vignetting you observed could be something to do with the angle at which the image is projected on the sensor. :biggrin:


Pawel, the tricky thing is to evaluate the vignetting on the live shot.I didn`t see any vignetting on MP till I actually shot this chart.If you shot the white smooth surface underexposed two stops, then you see it right away.
Yes, it is mysterious, and I was warned of possibility of vignetting on MP two years ago by some experts. maybe that is why they don't call it Digi MPs since MPs are not suitable for digital sensors.

I just picked up on this so ignore me if you have already covered it. But I have read in several places that CMOS sensors are much more sensitive to light striking on an angle and that it is important for lenses for digital cameras to be designed with this in mind.

It actually has led me to think that Canon EF-S lenses - which were designed specifically for the APS-C CMOS (about the same size as RED) - might actually be optically better performers on the RED than many of the cine lenses.

I have absolutely no testing to support this - it is merely speculation but it will be interesting to see how it works out. It might also explain how well the RED 18-50 actually performs as it is a "digital" design as well.

Have any of you been able to compare any of these?
 
  • Thread starter
  • Banned
  • #8
I just picked up on this so ignore me if you have already covered it. But I have read in several places that CMOS sensors are much more sensitive to light striking on an angle and that it is important for lenses for digital cameras to be designed with this in mind.

It actually has led me to think that Canon EF-S lenses - which were designed specifically for the APS-C CMOS (about the same size as RED) - might actually be optically better performers on the RED than many of the cine lenses.

I have absolutely no testing to support this - it is merely speculation but it will be interesting to see how it works out. It might also explain how well the RED 18-50 actually performs as it is a "digital" design as well.

Have any of you been able to compare any of these?

It is a plausible explanation, and something worth investigating further.

However, I’d like to point out that vignetting is just one property of lens performance. From what I have seen: sharpness, distortion and CA of UP and MP lenses are significantly better than those of still lenses that you mentioned. The image quality is far superior to any Canon L glass that I have used (most of them). In general, on 1.3 and 1.6 crop sensors, Canon L glass performed better for me than S-EF glass. Specifically the 10-22 zoom looks to me softer at all focal lengths than 16-35 f/2.8 II or 17-40 f/4 mounted on the same 1.6 crop camera (40D).
Most importantly, the 10-22mm appears to have even more vignetting fully opened at f/3.5 than 16mm MP at f/1.2 that Andrew demonstrated in his grabs. In terms of sharpness and contrast, my opinion is that 10-22mm sEF is simply in a different league to UP or MP glass. Not even comparable. You get what you pay for.
 
It is a plausible explanation, and something worth investigating further.

However, I’d like to point out that vignetting is just one property of lens performance. From what I have seen: sharpness, distortion and CA of UP and MP lenses are significantly better than those of still lenses that you mentioned. The image quality is far superior to any Canon L glass that I have used (most of them). In general, on 1.3 and 1.6 crop sensors, Canon L glass performed better for me than S-EF glass. Specifically the 10-22 zoom looks to me softer at all focal lengths than 16-35 f/2.8 II or 17-40 f/4 mounted on the same 1.6 crop camera (40D).
Most importantly, the 10-22mm appears to have even more vignetting fully opened at f/3.5 than 16mm MP at f/1.2 that Andrew demonstrated in his grabs. In terms of sharpness and contrast, my opinion is that 10-22mm sEF is simply in a different league to UP or MP glass. Not even comparable. You get what you pay for.

I suspect you are right on the 10-22, I am hoping that canon will see the need for an ultrawide EF-S prime 9 or 10mm similar to the 14mm EF. BTW any opinion on the Canon EF 14mm.?
 
I think MPs and the new 14mm Master Prime just introduced will have trouble to beat this one from Canon in terms of CA and resolving power.

What makes you think so?
 
What makes you think so?

I have Canon 14mm L II (new one) and I tested it with 21MP sensor.
Didn't test it with RED though.

So far what I have seen on the 21MP sensor it is nothing I have seen before on any other lenses. Only MP 65mm near the center can compare to the corners of Canaon.
And remember RED sensor is 24 mm wide and 14mm Canaon is for full size sensor.
 
Hi guys,

asap as Birger ships out, we will know exactly what the Canon "L" series do on RED, I'll stay away from anything else the the "L" series, for more then one reason, first the quality build and the material used in the glass elements, as far as vignetting performance, I can say that shooting with the 1Ds III 22MP camera FF is just as much as you can put any lens to the test, and the new 14L II on the super wide angle, performs great, and CA and Vignetting are so well controlled, even so I would have loved for the 14 to have a front screw in element for filters, but I use the LEE filter system, and it is great.


On the MP vs. UP note, I have been looking to purchase a set of MP, so this argument is of great interest, but at the end may I say that the chart those mean very little, when you capture stunning images in little to no light at T*1.3!


Again please forgive my arrogance, but the technicality behind each lens manufacturer and lens type, dies as soon as you capture something beautiful with it, and very few if any out of the Millions of viewers will ever say, oh did you see the CA and or the Vignetting on the shot were He grabs her and Kisses her?

I love to see what RED has done with their primes and the new 18-85, but very likely, cause of the need of super speeds, I'll end up buying a set of MP, so to me the argument, is more of speed then a little defect, which in all actuality same CA and Vignetting is nothing but desirable!

Ciao
 
I'll throw my 4¢ in here (Adjust for the inflated lens market).
Pretty much all the modern (80s and beyond) Cine lenses and all of the pro lenses made by Canon and Nikon in the last 12 years are going to out resolve the Mysterium sensor to within 15% of the edge of frame. Only very rarely and only in the most extreme circumstances will you be able to substantively discern the differences between even a lowly Zeiss Standard speed, a Nikon or Canon L and a brand new Master prime. Does that mean their not worth $30K a lens. Of course not, they have a bunch going for them including speed, the smoothest focus I've ever seen and truly beautiful Bokeh. I guess my point is that all of this lens projecting and Chart shooting is great and useful but it's probably more valuable to talk about theses lenses like what they are....

...Paintbrushes.

We can talk about how many hairs our paintbrushes have or how wide they are or how well they are made, but in the end it may be more useful to talk about the brush stroke than the bristles.
 
We can talk about how many hairs our paintbrushes have or how wide they are or how well they are made, but in the end it may be more useful to talk about the brush stroke than the bristles.

I would say this about many obsessive topics on this site. Unless you are a specialist in lens manufacturing or Dan Sasaki or something....
 
pink-lady-and-dogs-8.4.jpg


Review of older Canon 14mm 2.8 L USM lens

LINK>>>
 
Back
Top