Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

A Bayesian Quality-of-Experience Model for Adaptive Streaming Videos

A Bayesian Quality-of-Experience Model for Adaptive Streaming Videos The fundamental conflict between the enormous space of adaptive streaming videos and the limited capacity for subjective experiment casts significant challenges to objective Quality-of-Experience (QoE) prediction. Existing objective QoE models either employ pre-defined parametrization or exhibit complex functional form, achieving limited generalization capability in diverse streaming environments. In this study, we propose an objective QoE model, namely, the Bayesian streaming quality index (BSQI), to integrate prior knowledge on the human visual system and human annotated data in a principled way. By analyzing the subjective characteristics towards streaming videos from a corpus of subjective studies, we show that a family of QoE functions lies in a convex set. Using a variant of projected gradient descent, we optimize the objective QoE model over a database of training videos. The proposed BSQI demonstrates strong prediction accuracy in a broad range of streaming conditions, evident by state-of-the-art performance on four publicly available benchmark datasets and a novel analysis-by-synthesis visual experiment. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png ACM Transactions on Multimedia Computing Communications and Applications (TOMCCAP) Association for Computing Machinery

A Bayesian Quality-of-Experience Model for Adaptive Streaming Videos

Download PDF
24 pages

Loading next page...
 
/lp/association-for-computing-machinery/a-bayesian-quality-of-experience-model-for-adaptive-streaming-videos-m590yc8Y2U
Publisher
Association for Computing Machinery
Copyright
Copyright © 2022 Association for Computing Machinery.
ISSN
1551-6857
eISSN
1551-6865
DOI
10.1145/3491432
Publisher site
See Article on Publisher Site

Abstract

The fundamental conflict between the enormous space of adaptive streaming videos and the limited capacity for subjective experiment casts significant challenges to objective Quality-of-Experience (QoE) prediction. Existing objective QoE models either employ pre-defined parametrization or exhibit complex functional form, achieving limited generalization capability in diverse streaming environments. In this study, we propose an objective QoE model, namely, the Bayesian streaming quality index (BSQI), to integrate prior knowledge on the human visual system and human annotated data in a principled way. By analyzing the subjective characteristics towards streaming videos from a corpus of subjective studies, we show that a family of QoE functions lies in a convex set. Using a variant of projected gradient descent, we optimize the objective QoE model over a database of training videos. The proposed BSQI demonstrates strong prediction accuracy in a broad range of streaming conditions, evident by state-of-the-art performance on four publicly available benchmark datasets and a novel analysis-by-synthesis visual experiment.

Journal

ACM Transactions on Multimedia Computing Communications and Applications (TOMCCAP) – Association for Computing Machinery

Published: Feb 11, 2023

Keywords: Quality-of-experience assessment

References

  • Learning to predict streaming video QoE: Distortions, rebuffering and memory
    [,
  • A simple prediction fusion improves data-driven full-reference video quality assessment models
    [,
  • Continuous prediction of streaming video QoE using dynamic networks
    [,
  • Towards perceptually optimized end-to-end adaptive video streaming
    [,
  • Study of temporal effects on subjective video quality of experience
    [,
  • SDNDASH: Improving QoE of HTTP adaptive streaming using software defined networking
    [,
  • Pattern Recognition and Machine Learning
    [,
  • Distributed optimization and statistical learning via the alternating direction method of multipliers
    [,
  • Random forests
    [,
  • Cisco Visual Networking Index: Global Mobile Data Traffic Forecast Update, 2016–2021 White Paper
    [,
  • Complexity-based consistent-quality encoding in the cloud
    [,
  • Understanding the impact of video quality on user engagement
    [,
  • A unified bias-variance decomposition
    [,
  • Waterloo Streaming Quality-of-Experience Database IV
    [,
  • Pairwise Comparison of Objective QoE Models via Analysis-by-synthesis
    [,
  • Assessing the quality-of-experience of adaptive bitrate video streaming
    [,
  • To Appear
    [,
  • Quality-of-experience of adaptive video streaming: Exploring the space of adaptations
    [,
  • Quality-of-experience for adaptive streaming videos: An expectation confirmation theory motivated approach
    [,
  • A quality-of-experience database for adaptive video streaming
    [,
  • A quality-of-experience index for streaming video
    [,
  • Bidirectional LSTM for continuously predicting QoE in HTTP adaptive streaming
    [,
  • Microsoft Smooth Streaming
    [,
  • Streaming video QoE modeling and prediction: A long short-term memory approach
    [,
  • A survey on concept drift adaptation
    [,
  • A subjective and objective study of stalling events in mobile streaming videos
    [,
  • Learning a continuous-time streaming video QoE model
    [,
  • Representation switch smoothing for adaptive HTTP streaming
    [,
  • Neural Network Design
    [,
  • Multilayer feedforward networks are universal approximators
    [,
  • Internet video delivery in YouTube: From traffic measurements to quality of experience
    [,
  • Quantification of YouTube QoE via crowdsourcing
    [,
  • Comyco: Quality-aware adaptive video streaming via imitation learning
    [,
  • A buffer-based approach to rate adaptation: Evidence from a large video streaming service
    [,
  • 2000 fps real-time vision system with high-frame-rate video recording
    [,
  • Recommendation: Methodology for the Subjective Assessment of the Quality of Television Pictures
    [,
  • Improving fairness, efficiency, and stability in HTTP-based adaptive video streaming with FESTIVE
    [,
  • High dynamic range video
    [,
  • QoE assessment model for video streaming service using QoS parameters in wired-wireless network
    [,
  • GPAC: Open source multimedia framework
    [,
  • Optimal Adaptive Streaming Formats MPEG-DASH & HLS Segment Length
    [,
  • Toward a Practical Perceptual Video Quality Metric
    [,
  • To Appear
    [,
  • Probe and adapt: Rate adaptation for HTTP video streaming at scale
    [,
  • End-to-end blind quality assessment of compressed videos using deep neural networks
    [,
  • A case for a coordinated internet video control plane
    [,
  • Deriving and validating user experience model for DASH video streaming
    [,
  • Group maximum differentiation competition: Model comparison with few samples
    [,
  • Neural adaptive video streaming with pensieve
    [,
  • Quality of Service in Communications Networks
    [,
  • QDASH: A QoE-aware DASH system
    [,
  • Video quality assessment on mobile devices: Subjective, behavioral and objective studies
    [,
  • Perceptual quality assessment of high frame rate video
    [,
  • Per-title Encode Optimization
    [,
  • Light Field Photography with a Hand-held Plenoptic Camera
    [,
  • Flicker effects in adaptive video streaming to handheld devices
    [,
  • The impact of network impairment on quality of experience (QoE) in H
    [,
  • A cognitive model of the antecedents and consequences of satisfaction decisions
    [,
  • Parametric Bitstream-based Quality Assessment of Progressive Download and Adaptive Audiovisual Streaming Services Over Reliable Transport
    [,
  • Sporadic frame dropping impact on quality perception
    [,
  • Impact of video content and transmission impairments on Quality of Experience
    [,
  • Image database TID2013: Peculiarities, results and perspectives
    [,
  • Perceptual experience of time-varying video quality
    [,
  • Display device-adapted video quality-of-experience assessment
    [,
  • Commute path bandwidth traces from 3G networks: Analysis and applications
    [,
  • The impact of video-quality-level switching on user quality of experience in dynamic adaptive streaming over HTTP
    [,
  • A statistical evaluation of recent full reference image quality assessment algorithms
    [,
  • Quality of experience estimation for adaptive HTTP/TCP video streaming using H
    [,
  • BOLA: Near-optimal bitrate adaptation for online videos
    [,
  • OSQP: An operator splitting solver for quadratic programs
    [,
  • Optimal selection of adaptive streaming representations
    [,
  • How to Analyze Paired Comparison Data
    [,
  • HTTP/2-based adaptive streaming of HEVC video over 4G/LTE networks
    [,
  • Final Report from the Video Quality Experts Group on the Validation of Objective Models of Video Quality Assessment
    [,
  • Internet QoS: Architectures and Mechanisms for Quality of Service
    [,
  • Image quality assessment: From error visibility to structural similarity
    [,
  • Mean squared error: Love it or leave it? A new look at signal fidelity measures
    [,
  • Method and system for automatic user quality-of-experience measurement of streaming video
    [,
  • Begin with the end in mind: A unified end-to-end quality-of-experience monitoring, optimization and management framework
    [,
  • Maximum differentiation (MAD) competition: A methodology for comparing computational models of perceptual quantities
    [,
  • Method and system for smart adaptive video streaming driven by perceptual quality-of-experience estimations
    [,
  • Objective video quality assessment method for evaluating effects of freeze distortion in arbitrary video scenes
    [,
  • Assessing quality of experience for adaptive HTTP video streaming
    [,
  • A control-theoretic approach for dynamic adaptive video streaming over HTTP
    [,
  • A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP
    Yin, X.; Jindal, A.; Sekar, V.; Sinopoli, B.