Structured representation of multiview depth imagery.

Structured multiview depth imagery.

This work propose a method for interpolating multiview imagery which uses structured depth maps and multiview video plus inter-view connection information to represent a three-dimensional (3D) scene. The structured depth map consists of an inter-view consistent principal depth map and auxiliary depth information. The structured depth maps address the inconsistencies among estimated depth maps which may degrade the quality of rendered virtual views. Generated from multiple depth observations, the structuring of the depth maps is based on tested and adaptively chosen inter-view connections. Further, the use of connection information on the multiview video minimizes distortion due to varying illumination in the interpolated virtual views. Our approach improves the quality of rendered virtual views by up to 4 dB when compared to the reference MPEG view synthesis software for emerging multimedia services like 3D television and free-viewpoint television. Our approach obtains first the structured depth maps and the corresponding connection information. Second, it exploits the inter-view connection information when interpolating virtual views.

Publications

• Pravin Kumar Rana and Markus Flierl:
  View Interpolation with Structured Depth from Multiview Video,
  In Proceedings of European Signal Processing Conference (EUSIPCO), Barcelona, Spain, August 2011.
• Pravin Kumar Rana and Markus Flierl:
  Depth Consistency Testing for Improved View Interpolation,
  In Proceedings of IEEE International Workshop on Multimedia Signal Processing (MMSP), Saint-Malo, France, October 2010.