Deep Learning for Quality Assessment in Live Video Streaming

Vega, Maria Torres; Mocanu, Decebal Constantin; Famaey, Jeroen; Stavrou, Stavros; Liotta, Antonio

Abstract

Video content providers put stringent requirements on the quality assessment methods realized on their services. They need to be accurate, real-time, adaptable to new content, and scal-able as the video set grows. In this letter, we introduce a novel automated and computationally efficient video assessment method. It enables accurate real-time (online) analysis of delivered quality in an adaptable and scalable manner. Offline deep unsupervised learning processes are employed at the server side and inexpensive no-reference measurements at the client side. This provides both real-time assessment and performance comparable to the full reference counterpart, while maintaining its no-reference characteristics. We tested our approach on the LIMP Video Quality Database (an extensive packet loss impaired video set) obtaining a correlation between 78% and 91% to the FR benchmark (the video quality metric). Due to its unsupervised learning essence, our method is flexible and dynamically adaptable to new content and scalable with the number of videos.
Index Terms-Deep learning (DL), multimedia video services, unsupervised learning (UL), video quality assessment.

• Journal Article Type: Article
• Acceptance Date: Apr 2, 2017
• Online Publication Date: Apr 5, 2017
• Publication Date: 2017-06
• Deposit Date: Aug 2, 2019
• Publicly Available Date: Aug 2, 2019
• Journal: IEEE Signal Processing Letters
• Print ISSN: 1070-9908
• Electronic ISSN: 1558-2361
• Publisher: Institute of Electrical and Electronics Engineers
• Peer Reviewed: Peer Reviewed
• Volume: 24
• Issue: 6
• Pages: 736-740
• DOI: https://doi.org/10.1109/lsp.2017.2691160
• Keywords: Deep learning (DL), multimedia video services, unsupervised learning (UL), video quality assessment
• Public URL: http://researchrepository.napier.ac.uk/Output/2022644