Streaming across viewing conditions - The effect of viewing distance and display luminance on video quality
Dounia Hammou, Lukáš Krasula, Christos G. Bampis, Zhi Li, Rafał K. Mantiuk
Abstract
The visibility of streamed video distortions is affected by the user's display and viewing conditions, such as their display's luminance or the viewing distance. Distortions become less visible at lower luminance levels or farther viewing distances. However, most image and video quality metrics assume fixed optimal display and viewing conditions, making them insensitive to the viewing conditions. In this work, we demonstrate how existing metrics can be adapted to account for both factors and compare such an adaptation with the metrics that natively model viewing conditions. First, we collected a new video quality dataset, HDR-VDC, which contains streaming distortions in 4K HDR videos. The dataset consists of 12 4K and 4 FHD HDR source video content, each distorted with AV1 encoding and Lanczos upscaling from a lower resolution. The quality loss due to the distortions was measured at two viewing distances, corresponding to 60 and 120 pixels per visual degree, and two display mean luminance levels, varying by a factor of 8 in terms of luminance. Next, we developed a pre-processing framework that lets us adapt many quality metrics so that they can evaluate content across the viewing distances and luminance levels. The framework employs a display model and perceptually uniform encoding, PU21, to account for the effect of display luminance, and perspective projection scaling (PPS) to account for the effect of viewing distance. We used the framework to compare the performance of 35 state-of-the-art metrics. This allowed us to identify a selection of existing quality metrics that can be effectively adapted to account for the viewing conditions.
Create a lesson
Related papers
AnyVIO: Feed-Forward Streaming Visual-Inertial Odometry Across Platforms
Omoruyi Atekha, Marcus Greiff, Ray Zhang et al.
Susceptibility source separation via Closed-form Alternating Newton-type Optimization
Ignacio Contreras-Zúñiga, Cristian Tejos, Carlos Milovic
Physics-Informed Deep Learning for Shear Wave Speed Estimation in MR Elastography
Stefan Martin, Jakob Schattenfroh, Patrick Schuenke et al.
LBW-NPS: A Local Band-Weighted Noise Power Spectrum Loss for Texture-Preserving Low-Dose CT Denoising
Fatma Elif Yalçındağ, Mehmet Ozan Ünal, Metin Ertaş et al.
Life-IQA+: Boosting Blind Image Quality Assessment via GCN-enhanced Layer Interaction and Flexible Hierarchical Expert Specialization
Long Tang, Guoquan Zheng, Huiyu Duan et al.
Uncertainty-Aware Multimodal Deep Learning for Prediction of Radiation-Induced Xerostomia in Head and Neck Cancer
Jin Yang, Tian Liu, Jose Penagaricano et al.