A Tutorial on Immersive Video Delivery: From Omnidirectional Video to Holography

Jeroen van der Hooft; Hadi Amirpour; Maria Torres Vega; Yago Sanchez; Raimund Schatz; Thomas Schierl; Christian Timmerer

doi:10.1109/COMST.2023.3263252

A Tutorial on Immersive Video Delivery: From Omnidirectional Video to Holography

Jeroen van der Hooft, Hadi Amirpour, Maria Torres Vega, Yago Sanchez, Raimund Schatz, Thomas Schierl, Christian Timmerer

Experience Contexts & Tools

Research output: Contribution to journal › Article › peer-review

Abstract

Video services are evolving from traditional two-dimensional video to virtual reality and holograms, which offer six degrees of freedom to users, enabling them to freely move around in a scene and change focus as desired. However, this increase in freedom translates into stringent requirements in terms of ultra-high bandwidth (in the order of Gigabits per second) and minimal latency (in the order of milliseconds). To realize such immersive services, the network transport, as well as the video representation and encoding, have to be fundamentally enhanced. The purpose of this tutorial article is to provide an elaborate introduction to the creation, streaming, and evaluation of immersive video. Moreover, it aims to provide lessons learned and to point at promising research paths to enable truly interactive immersive video applications toward holography.

Original language	English
Pages (from-to)	1336-1375
Number of pages	40
Journal	IEEE Communications Surveys & Tutorials
Volume	25
Issue number	2
DOIs	https://doi.org/10.1109/COMST.2023.3263252
Publication status	Published - 30 Mar 2023

Research Field

Former Research Field - Experience Measurement

Keywords

Immersive video delivery
3DoF
6DoF
omnidirectional video
volumetric video
point clouds
meshes
light fields
holography
end-to-end systems

Access to Document

10.1109/COMST.2023.3263252

Cite this

@article{31b69ee069554b949d8a923181af4c32,

title = "A Tutorial on Immersive Video Delivery: From Omnidirectional Video to Holography",

abstract = "Video services are evolving from traditional two-dimensional video to virtual reality and holograms, which offer six degrees of freedom to users, enabling them to freely move around in a scene and change focus as desired. However, this increase in freedom translates into stringent requirements in terms of ultra-high bandwidth (in the order of Gigabits per second) and minimal latency (in the order of milliseconds). To realize such immersive services, the network transport, as well as the video representation and encoding, have to be fundamentally enhanced. The purpose of this tutorial article is to provide an elaborate introduction to the creation, streaming, and evaluation of immersive video. Moreover, it aims to provide lessons learned and to point at promising research paths to enable truly interactive immersive video applications toward holography.",

keywords = "Immersive video delivery, 3DoF, 6DoF, omnidirectional video, volumetric video, point clouds, meshes, light fields, holography, end-to-end systems",

author = "{van der Hooft}, Jeroen and Hadi Amirpour and {Torres Vega}, Maria and Yago Sanchez and Raimund Schatz and Thomas Schierl and Christian Timmerer",

note = "Q1 2023",

year = "2023",

month = mar,

day = "30",

doi = "10.1109/COMST.2023.3263252",

language = "English",

volume = "25",

pages = "1336--1375",

journal = "IEEE Communications Surveys & Tutorials",

issn = "1553-877X",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

number = "2",

}

TY - JOUR

T1 - A Tutorial on Immersive Video Delivery: From Omnidirectional Video to Holography

AU - van der Hooft, Jeroen

AU - Amirpour, Hadi

AU - Torres Vega, Maria

AU - Sanchez, Yago

AU - Schatz, Raimund

AU - Schierl, Thomas

AU - Timmerer, Christian

N1 - Q1 2023

PY - 2023/3/30

Y1 - 2023/3/30

N2 - Video services are evolving from traditional two-dimensional video to virtual reality and holograms, which offer six degrees of freedom to users, enabling them to freely move around in a scene and change focus as desired. However, this increase in freedom translates into stringent requirements in terms of ultra-high bandwidth (in the order of Gigabits per second) and minimal latency (in the order of milliseconds). To realize such immersive services, the network transport, as well as the video representation and encoding, have to be fundamentally enhanced. The purpose of this tutorial article is to provide an elaborate introduction to the creation, streaming, and evaluation of immersive video. Moreover, it aims to provide lessons learned and to point at promising research paths to enable truly interactive immersive video applications toward holography.

AB - Video services are evolving from traditional two-dimensional video to virtual reality and holograms, which offer six degrees of freedom to users, enabling them to freely move around in a scene and change focus as desired. However, this increase in freedom translates into stringent requirements in terms of ultra-high bandwidth (in the order of Gigabits per second) and minimal latency (in the order of milliseconds). To realize such immersive services, the network transport, as well as the video representation and encoding, have to be fundamentally enhanced. The purpose of this tutorial article is to provide an elaborate introduction to the creation, streaming, and evaluation of immersive video. Moreover, it aims to provide lessons learned and to point at promising research paths to enable truly interactive immersive video applications toward holography.

KW - Immersive video delivery

KW - 3DoF

KW - 6DoF

KW - omnidirectional video

KW - volumetric video

KW - point clouds

KW - meshes

KW - light fields

KW - holography

KW - end-to-end systems

U2 - 10.1109/COMST.2023.3263252

DO - 10.1109/COMST.2023.3263252

M3 - Article

SN - 1553-877X

VL - 25

SP - 1336

EP - 1375

JO - IEEE Communications Surveys & Tutorials

JF - IEEE Communications Surveys & Tutorials

IS - 2

ER -

A Tutorial on Immersive Video Delivery: From Omnidirectional Video to Holography

Abstract

Research Field

Keywords

Access to Document

Fingerprint

Cite this