Graphics & Media Lab CMC of Lomonosov Moscow State University has about 10 years’ experience in comprehensive analyzing of compressed video. Recently the Graphics & Media Lab (further: the Lab) has published its first detailed report on Stereo-Film-Quality Analysis within VQMT3D (Video Quality Measurement Tool for 3D) Project. Meanwhile the Lab is working on the next four reports on stereoscopic video quality estimation. They are expected to be made public in the second half of 2013.
Stereo and multiview video entertainment has become a very popular trend. A rapidly growing demand for 3D films after Avatar release inspired the production houses to create a lot of new stereo content. But sometimes doing fast doesn’t mean doing it well enough. Insufficient stereo video quality provoked in the audience such ‘special effects’ as eyestrain and headache after visiting 3D cinemas. The Lab decided to analyze five stereo films, captured with stereoscopic camera systems and to investigate the reasons of the irritating annoyance. Finding just a set of bad frames is rather a simple task, but it is not a useful result for a comparative analysis. For achieving a valuable result it’s important to estimate a ratio of bad and well-done frames in a movie. Such results enable finding the worst frames in one movie or comparing different films. For the purpose of revealing stereoscopic errors the Lab developed a unique tool for stereo video quality measurement (VQMT3D). Its algorithms are able to discover the key reasons of visual discomfort from 3D films viewing:
1. horizontal disparity
2. vertical disparity
3. color mismatch
4. sharpness mismatch
The free downloadable report consists of 246 pages and comprises of three main parts:
1. Thorough description of visual-discomfort potential causes while viewing stereo 3D films. Explanation of human vision physics and the stereo errors impact on human eyes from an ophthalmologist professional point of view.
2. Detailed analysis of five films. Each film description consists of two parts:
a) Full per-frame analysis with charts showing metric values for each frame
b) Visualizations demonstrating artefacts in frames that earned a poor rating according to their metrics
3. Overall film comparison. The charts depict the average metric values and distribution of these values in each film.
Potential reasons of visual distortion, caused by stereo films:
1. Accommodation-convergence conflict
2. Horizontal disparity
3. Vertical disparity
4. Interocular differences in contrast/luminance
5. The effects of blur (symmetric and asymmetric)
Ross Copeland (Post Production Stereographer) described the key artifacts in stereo films and the means of eliminating the errors:
“Filming 3D is complex, and even the best rigs and crews can end up with some issues in shots that must then be fixed in postproduction. Filming for 3DTV programs is far more likely to result in more extreme errors and mismatches owing to the budget and time constraints of today’s TV programs. Some problems can be fixed easily, some are very difficult and some cannot be fixed at all. Horizontal and vertical parallax and color mismatch are the most common issues and are generally very easy to fix. It may be possible to fix small sharpness or focus disparities using the proper software, but as with parallax and color, if the mismatches are extreme, these problems will be more difficult, if not impossible, to fix. Other issues may also arise, such as keystoning, edge violations, occlusion, retinal rivalry, light polarization, and pitch or tilt (also known as the “near-far problem”), among others. Although I do assess issues visually, I also use software tools with histograms, waveforms and various display options to help determine the exact amount of adjustment needed to improve a shot. Additional development of such tools will help improve 3D filming, making my job easier and helping produce a much more comfortable viewer experience.”
The proposed evaluation methodology provides a value for each frame of an evaluated stereo film. An average result for the film Avatar has been used as a reference value (marked green), because it was the first popular and high-quality stereoscopic film. These reference-level lines are especially useful when dealing with rather obscure color and sharpness mismatch metrics.
Per-frame video evaluation enables detection of the worst frames in a film or detection of the scenes that should be fixed primarily. Color and sharpness mismatch values are presented as dimensionless. The values represent the strength of the color or sharpness difference between two views of a stereoscopic frame. The greater is the color mismatch, the higher is the value for this metric. The sharpness mismatch value depends on the size of the region containing the sharpness mismatch and the strength of this
mismatch.
Demonstration of color-mismatch issues detection in Resident Evil: Afrerlife using per-frame charts (Image # 41425):
Horizontal disparity values are measured in percent of frame width. Vertical disparity is measured in
permil (h) of frame width. A permil is a one-tenth of a percent. A tilt is measured in degrees.
Percents and permils are used to get invariant values relative to the actual frame width measured in pixels.
For vertical disparity, the lower value means better video quality.
Demonstration of vertical-disparity issues detection in Resident Evil: Afrerlife using per-frame charts (Image #2):
