Interactive Streaming of Stored Multiview Video Using Redundant Frame Structures

—While much of multiview video coding focuses on the rate-distortion performance of compressing all frames of all views for storage or non-interactive video delivery over networks, we address the problem of designing a frame structure to enable interactive multiview streaming, where clients can interactively switch views during video playback. Thus, as a client is playing back successive frames (in time) for a given view, it can send a request to the server to switch to a different view while continuing uninterrupted temporal playback. Noting that standard tools for random access (i.e., I-frame insertion) can be bandwidth-inefficient for this application, we propose a redundant representation of I-, P-, and “merge” frames, where each original picture can be encoded into multiple versions, appropriately trading off expected transmission rate with storage, to facilitate view switching. We first present ad hoc frame structures with good performance when the view-switching probabil...

• Type: Journal
• Year: 2011
• Where: TIP
• Authors: Gene Cheung, Antonio Ortega, Ngai-Man Cheung
• Keywords: Frame Structures, I-frame Insertion, TIP 2011, Uninterrupted Temporal Playback