Multiview Video Coding

hideThis article has multiple issues. Please help or discuss these issues on the talk page. (Learn how and when to remove these template messages) This article needs additional citations for verification. Please help by adding citations to reliable sources. Unsourced material may be challenged and removed. Find sources:  –  ·  ·  · scholar · JSTOR (July 2011) (Learn how and when to remove this template message) This article's tone or style may not reflect the encyclopedic tone used on Wikipedia. Relevant discussion may be found on the talk page. See Wikipedia's guide to writing better articles for suggestions. (January 2015) (Learn how and when to remove this template message) (Learn how and when to remove this template message)

Multiview Video Coding (MVC, also known as MVC 3D) is a stereoscopic video coding standard for video compression that allows for the efficient encoding of video sequences captured simultaneously from multiple camera angles in a single video stream.^[1] It uses the 2D plus Delta method and is an amendment to the H.264 (MPEG-4 AVC) video compression standard, developed jointly by MPEG and VCEG,^[2] with contributions from a number of companies, primarily Panasonic and LG Electronics.^[3]

MVC formatting is intended for encoding stereoscopic (two-view) 3D video, as well as free viewpoint television and multi-view 3D television. The Stereo High profile has been standardized in June 2009; the profile is based on the MVC toolset and is used in stereoscopic Blu-ray 3D releases.^[4]

Technical overview[]

MVC is based on the idea that video recordings of the same scene from multiple angles share many common elements. It is possible to encode all simultaneous frames captured in the same elementary stream and to share as much information as possible across the different layers. This can reduce size of the encoded video.^[5][6]

Multiview video contains a large amount of inter-view statistical dependencies, since all cameras capture the same scene from different viewpoints. Therefore, combined temporal and inter-view prediction is important for efficient MVC encoding. A frame from a certain camera can be predicted not only from temporally related frames from the same camera, but also from the frames of neighboring cameras. These interdependencies can be used for efficient prediction.^[7][8][9]

The method for this used in Multiview Video Coding for Blu-ray 3D movies is known as the 2D plus Delta algorithm, and the MVC specification itself is part of the H.264 standard as an amendment in H.264 "Annex H" of the specification.^[10]

Open source support mostly missing[]

This section contains information of unclear or questionable importance or relevance to the article's subject matter. Please this section by clarifying or removing indiscriminate details. If importance cannot be established, the section is likely to be moved to another article, pseudo-redirected, or removed. Find sources:  –  ·  ·  · scholar · JSTOR (December 2020) (Learn how and when to remove this template message)

As of April 2015, there is still no free and open-source software that supports software decoding of the MVC video compression standard. So popular open source H.264 and HEVC (H.265) decoders such as those used in the FFmpeg and Libav libraries simply ignore the additional information for the second view and thus do not show the second view for stereoscopic views. In most cases the reason for this support not being added is that MVC was not considered when the initial core H.264 and HEVC decoders code was written so it was coded in one large chunk, and later amendment would as such often mean a lot of prerequisite code refactoring work and large changes its current architecture, with major work in untangling and reordering some code, and splitting different functions in existing decoder code into smaller chunks for simpler handling to in turn then make amendments such as MVC easier to add.^[11]

Some proof-of-concept work has however been done downstream in the past but never made it upstream into official releases of FFmpeg or Libav.^[12][13]

On March 8, 2016, the situation improved. Version 0.68 of the DirectShow Media Splitter and Decoders Collection LAV Filters^[14] was released by developer "Nevcairiel" (who also works for Media Player Classic - Home Cinema (MPC-HC)) with support of H.264 MVC 3D demuxing and decoding. With the aid of this release and FRIM ^[15] written by a programmer named "videohelp3d" ^[16] it is possible to write an AviSynth script to pre process a H.264 MVC 3D video clip which can then be opened by free 3D video player ^[17] and then shown as red - cyan anaglyph video for example.

The usage of the FRIM AviSynth plugin (FRIMSource) is described on "videohelp3d" home page. LAV Filters can be used to get audio from H.264 MVC 3D video clip. The developer ^[18] posted that in a future release of it might be possible that LAV Video renders the video as Side-by-Side directly.

Patent holders[]

The following organizations hold patents that contributed to the development of MVC technology, listed in a patent pool by MPEG LA.

See also[]

• 2D plus Delta
• 2D-plus-depth
• Stereoscopic video coding
• Digital 3D
• Stereoscopic
• TDVision
• 3D television
• 3DTV
• 3D display
• 3-D film
• Crosstalk
• Stereoscopy
• 3D Blu-ray Disc
• List of 3D films

References[]

External links[]

• Mitsubishi Electric Research Laboratories – Multiview Video Coding project
• MPEG – Technologies – Introduction to Multiview Video Coding
• MPEG – Technologies – Introduction to 3D Video
• MPEG – Visions – 3D Video Vision
• Nokia Research Center – Mobile 3D Video project and MVC source code
• NetBlender – MVC encoding solution for 3D Blu-ray authoring
• TDVision Systems, Inc – Stereoscopic decoding patents:
  • TDVision Systems, Inc – Stereoscopic encoding patent^{[permanent dead link]}
  • TDVision Systems, Inc – Stereoscopic decoding patent^{[permanent dead link]}