Mitch Gross
Well-known member
- Joined
- Nov 7, 2007
- Messages
- 3,657
- Reaction score
- 0
- Points
- 0
I posted this elsewhere but thought it bears repeating here. I'm not a fan of this Shootout and think it does more damage than good. It does not show the abilities of the EPIC or other cameras in any meaningful or even accurate way.
Part Three is the only part that has any worthwhile information, yet it is still
a highly flawed and in the end not useful presentation.
First off, this section begins by stating that it is for the "pixel peepers."
I'm sorry, but I resent that. Zacuto is saying that those who want real
technical data in some form are a bunch of eggheads, some kind of intellectual
elitist nerds who are best kept holed up where their pocket protectors and
horned rimmed glasses won't hurt any regular folk. You're presenting a shootout
of a bunch of cameras -- who do you think is watching this, gentlemen farmers?
I also notice that this section has by far the least amount of commentary by the
audience groups as compared to the other sections, as well as the least amount
of explanation of the shooting and testing procedures compared to the outlining
given in the earlier two sections. I'm going out on a limb here to say that I
think this is because the makers of this test didn't really care about this part
as much and/or didn't see its value as high as the others. I feel the opposite.
But okay, let's just pretend that parts one & two never happened and just look
at this section. What's wrong & right with it?
"Objective" shooting with all cameras using the same lighting, and then the
result is seen "uncorrected." But wait a second, cameras such as the RED EPIC
and the Sony F65 shoot RAW. What does "uncorrected" mean? Does it mean that
the RAW data was presented in a standard REC709 color space? Maybe, I don't
know. Was the Alexa shooting in ProRes 4444 or was it capturing in ARRIRAW?
Was it using LOG-C? What settings were used on the F3, or the 7D for that
matter? None of this is presented, although I guess it might be buried in the
.PDF files. Maybe I'll have to "peep" over there.
The test shots are presented one after another, ordered by dollar value of
camera from lowest to highest. But they are never shown side-by-side. It is
impossible to compare the iPhone to the F65 because there are so many cameras
between them. The brain quickly is unable to distinguish the differences and
subtleties. That why side-by-sides are so important, because they help
eliminate false memory. If there are going to be side-by-side comparisons, why
not do it like they did last year, with one camera chosen as a reference
"control" and the others shown next to it for perspective?
But wait, there are side-by-sides (actually wipes & over/unders). The wipes
show the "uncorrected" image (whatever that means) and then the "corrected",
where the test runner does helpfully explain that he did his best to get the
cameras to match (remember that). The over/unders compared the "corrected"
one-light setups of Section Three to the re-lit and corrected setups from
Sections One & Two. I honestly couldn't give a crap about the over/under
comparisons. It's just telling me what the different DPs did to relight and it
says absolutely nothing about the cameras themselves. I guess if one is really
paying attention it could be noticed that the F65 is the identical shot because
the DP for that camera did not feel the need to relight at all in order to
capture the scene.
I barely give a crap about the wipes (Ew, what did I just say?) because that is
showing me how much the cameras can handle correction before falling apart.
Except it doesn't really because I'm looking at the whole thing as a compressed
Vimeo file which introduces so much banding an other issues that it's near
impossible to tell much. But the one thing it did show me oh-so-importantly is
that the correction is a cheat. Because there is so much more information
present in the higher level cameras that had to be thrown away in order to dumb
them down to be similar to the lesser ones. It was as if the decision was made
to try to make all the cameras look as much as possible like the Sony FS100,
which was pretty much in the middle of the price range of the group. The lesser
cameras with their fine detail resolving issues and limited dynamic range such
as the iPhone and the 7D struggled to reach up. But the "uncorrected" images
out of the Alexa, EPIC and F65 had vastly more i
nforma
tion available in highlights, shadows, gradations of color, fine texture
resolution and other aspects that were clamped away in the grade. In the end
some of what they could achieve could be perceived but it was highly truncated.
But the part that pissed me off the most about the whole shebang was at the end.
Entitled "The Takeaway," I expect that a lot of non-technical producers and
others will wake up from their slumbers to just listen to this, because IT IS
GOING TO TELL THEM THE SIMPLE ANSWER. And what are they told?
DP: "A lot of these cameras are good enough."
Colorist: "We could make them match."
Photographer: "They're pretty similar."
DP: "Despite [big price differences] there was a great similarity of palette."
and the most dangerous one of all
"It really comes down to the operator and the crew."
I said all along that this "shootout" set out to prove that there really is no
great difference between these cameras and the images they provide. All of the
"tests" were skewed to prove this assumption. It may have been a completely
subconscious act on their part, but the makers of this presentation started with
a thesis and did everything they could to prove it.
That last quote is the most dangerous one to me (there are others like it that
follow, but the implications are similar). If all these cameras are really
about the same and it really just comes down to the DP's skills, then
cinematographers never have the right to ask for better or more appropriate
equipment. The producer can say that a good DP should be able to make this
cheap camera sing, and if you cannot then you must be a hack and I'll find
someone better.
Tools matter. Without the appropriate tool an artist or craftsperson cannot do
as good a job. It is really that simple. This presentation continues to
obfuscate technical realities and present a fallacy. Part Three is only
slightly improved over Parts One & Two, but in the end they all cause more
damage than provide useful information.
Part Three is the only part that has any worthwhile information, yet it is still
a highly flawed and in the end not useful presentation.
First off, this section begins by stating that it is for the "pixel peepers."
I'm sorry, but I resent that. Zacuto is saying that those who want real
technical data in some form are a bunch of eggheads, some kind of intellectual
elitist nerds who are best kept holed up where their pocket protectors and
horned rimmed glasses won't hurt any regular folk. You're presenting a shootout
of a bunch of cameras -- who do you think is watching this, gentlemen farmers?
I also notice that this section has by far the least amount of commentary by the
audience groups as compared to the other sections, as well as the least amount
of explanation of the shooting and testing procedures compared to the outlining
given in the earlier two sections. I'm going out on a limb here to say that I
think this is because the makers of this test didn't really care about this part
as much and/or didn't see its value as high as the others. I feel the opposite.
But okay, let's just pretend that parts one & two never happened and just look
at this section. What's wrong & right with it?
"Objective" shooting with all cameras using the same lighting, and then the
result is seen "uncorrected." But wait a second, cameras such as the RED EPIC
and the Sony F65 shoot RAW. What does "uncorrected" mean? Does it mean that
the RAW data was presented in a standard REC709 color space? Maybe, I don't
know. Was the Alexa shooting in ProRes 4444 or was it capturing in ARRIRAW?
Was it using LOG-C? What settings were used on the F3, or the 7D for that
matter? None of this is presented, although I guess it might be buried in the
.PDF files. Maybe I'll have to "peep" over there.
The test shots are presented one after another, ordered by dollar value of
camera from lowest to highest. But they are never shown side-by-side. It is
impossible to compare the iPhone to the F65 because there are so many cameras
between them. The brain quickly is unable to distinguish the differences and
subtleties. That why side-by-sides are so important, because they help
eliminate false memory. If there are going to be side-by-side comparisons, why
not do it like they did last year, with one camera chosen as a reference
"control" and the others shown next to it for perspective?
But wait, there are side-by-sides (actually wipes & over/unders). The wipes
show the "uncorrected" image (whatever that means) and then the "corrected",
where the test runner does helpfully explain that he did his best to get the
cameras to match (remember that). The over/unders compared the "corrected"
one-light setups of Section Three to the re-lit and corrected setups from
Sections One & Two. I honestly couldn't give a crap about the over/under
comparisons. It's just telling me what the different DPs did to relight and it
says absolutely nothing about the cameras themselves. I guess if one is really
paying attention it could be noticed that the F65 is the identical shot because
the DP for that camera did not feel the need to relight at all in order to
capture the scene.
I barely give a crap about the wipes (Ew, what did I just say?) because that is
showing me how much the cameras can handle correction before falling apart.
Except it doesn't really because I'm looking at the whole thing as a compressed
Vimeo file which introduces so much banding an other issues that it's near
impossible to tell much. But the one thing it did show me oh-so-importantly is
that the correction is a cheat. Because there is so much more information
present in the higher level cameras that had to be thrown away in order to dumb
them down to be similar to the lesser ones. It was as if the decision was made
to try to make all the cameras look as much as possible like the Sony FS100,
which was pretty much in the middle of the price range of the group. The lesser
cameras with their fine detail resolving issues and limited dynamic range such
as the iPhone and the 7D struggled to reach up. But the "uncorrected" images
out of the Alexa, EPIC and F65 had vastly more i
nforma
tion available in highlights, shadows, gradations of color, fine texture
resolution and other aspects that were clamped away in the grade. In the end
some of what they could achieve could be perceived but it was highly truncated.
But the part that pissed me off the most about the whole shebang was at the end.
Entitled "The Takeaway," I expect that a lot of non-technical producers and
others will wake up from their slumbers to just listen to this, because IT IS
GOING TO TELL THEM THE SIMPLE ANSWER. And what are they told?
DP: "A lot of these cameras are good enough."
Colorist: "We could make them match."
Photographer: "They're pretty similar."
DP: "Despite [big price differences] there was a great similarity of palette."
and the most dangerous one of all
"It really comes down to the operator and the crew."
I said all along that this "shootout" set out to prove that there really is no
great difference between these cameras and the images they provide. All of the
"tests" were skewed to prove this assumption. It may have been a completely
subconscious act on their part, but the makers of this presentation started with
a thesis and did everything they could to prove it.
That last quote is the most dangerous one to me (there are others like it that
follow, but the implications are similar). If all these cameras are really
about the same and it really just comes down to the DP's skills, then
cinematographers never have the right to ask for better or more appropriate
equipment. The producer can say that a good DP should be able to make this
cheap camera sing, and if you cannot then you must be a hack and I'll find
someone better.
Tools matter. Without the appropriate tool an artist or craftsperson cannot do
as good a job. It is really that simple. This presentation continues to
obfuscate technical realities and present a fallacy. Part Three is only
slightly improved over Parts One & Two, but in the end they all cause more
damage than provide useful information.