STESCAL3D: Subjective evaluation of HD stereo video streaming using H.264 SVC in diverse laboratory environments

Charalampos Mysirlidis; Tasos Dagiuklas; Pedro M.R. Rocha; Luis A. Da Silva Cruz; Dino Kotaranin; Savina Gruicic; Emil Dumic; Athanassios Skodras

doi:10.1109/QoMEX.2015.7148151

STESCAL3D: Subjective evaluation of HD stereo video streaming using H.264 SVC in diverse laboratory environments

Charalampos Mysirlidis, Tasos Dagiuklas, Pedro M.R. Rocha, Luis A. Da Silva Cruz, Dino Kotaranin, Savina Gruicic, Emil Dumic, Athanassios Skodras

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

2 Citations (Scopus)

Abstract

This paper presents a new 3D video database (STESCAL3D -Stereoscopic Scalable 3D), made up of 3D stereo video sequences affected by different types of degradations. A set of subjective quality grades have been collected in three geographically displaced sites. The database contents have been produced using scalable video coding to encode 3D stereo video clips with distinct encoding parameters, after which different transmission degradations have been applied to the encoded video streams. These sequences have been subjectively evaluated by observers from three countries, Croatia, Portugal and Greece, using a purpose-built web-based platform. The subjective quality data compiled were processed, analyzed and compared to quality estimates obtained using several well-known objective measures. It is shown that the correlation between objective quality estimates and the subjective quality grades is in general low. Additionally the results show that stereo-view asymmetries in terms of encoding parameters and packet loss ratio (PLR) leads to low quality of experience. The video database and the subjective grades collection are publicly available with the referral link provided in the text.

Original language	English
Title of host publication	2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781479989584
DOIs	https://doi.org/10.1109/QoMEX.2015.7148151
Publication status	Published - 2 Jul 2015
Externally published	Yes
Event	2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015 - Costa Navarino, Messinia, Greece Duration: 26 May 2015 → 29 May 2015

Publication series

Name	2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015

Conference

Conference	2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015
Country/Territory	Greece
City	Costa Navarino, Messinia
Period	26/05/15 → 29/05/15

Bibliographical note

Publisher Copyright:
© 2015 IEEE.

Keywords

3D video
objective measures
QoE
STESCAL3D database
subjective evaluation

Access to Document

10.1109/QoMEX.2015.7148151

Cite this

Mysirlidis, C., Dagiuklas, T., Rocha, P. M. R., Da Silva Cruz, L. A., Kotaranin, D., Gruicic, S., Dumic, E., & Skodras, A. (2015). STESCAL3D: Subjective evaluation of HD stereo video streaming using H.264 SVC in diverse laboratory environments. In 2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015 Article 7148151 (2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/QoMEX.2015.7148151

Mysirlidis, Charalampos ; Dagiuklas, Tasos ; Rocha, Pedro M.R. et al. / STESCAL3D : Subjective evaluation of HD stereo video streaming using H.264 SVC in diverse laboratory environments. 2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015. Institute of Electrical and Electronics Engineers Inc., 2015. (2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015).

@inproceedings{001362a080f7440b90de192c98e8c60a,

title = "STESCAL3D: Subjective evaluation of HD stereo video streaming using H.264 SVC in diverse laboratory environments",

abstract = "This paper presents a new 3D video database (STESCAL3D -Stereoscopic Scalable 3D), made up of 3D stereo video sequences affected by different types of degradations. A set of subjective quality grades have been collected in three geographically displaced sites. The database contents have been produced using scalable video coding to encode 3D stereo video clips with distinct encoding parameters, after which different transmission degradations have been applied to the encoded video streams. These sequences have been subjectively evaluated by observers from three countries, Croatia, Portugal and Greece, using a purpose-built web-based platform. The subjective quality data compiled were processed, analyzed and compared to quality estimates obtained using several well-known objective measures. It is shown that the correlation between objective quality estimates and the subjective quality grades is in general low. Additionally the results show that stereo-view asymmetries in terms of encoding parameters and packet loss ratio (PLR) leads to low quality of experience. The video database and the subjective grades collection are publicly available with the referral link provided in the text.",

keywords = "3D video, objective measures, QoE, STESCAL3D database, subjective evaluation",

author = "Charalampos Mysirlidis and Tasos Dagiuklas and Rocha, {Pedro M.R.} and {Da Silva Cruz}, {Luis A.} and Dino Kotaranin and Savina Gruicic and Emil Dumic and Athanassios Skodras",

note = "Publisher Copyright: {\textcopyright} 2015 IEEE.; 2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015 ; Conference date: 26-05-2015 Through 29-05-2015",

year = "2015",

month = jul,

day = "2",

doi = "10.1109/QoMEX.2015.7148151",

language = "English",

series = "2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015",

address = "United States",

}

Mysirlidis, C, Dagiuklas, T, Rocha, PMR, Da Silva Cruz, LA, Kotaranin, D, Gruicic, S, Dumic, E & Skodras, A 2015, STESCAL3D: Subjective evaluation of HD stereo video streaming using H.264 SVC in diverse laboratory environments. in 2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015., 7148151, 2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015, Institute of Electrical and Electronics Engineers Inc., 2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015, Costa Navarino, Messinia, Greece, 26/05/15. https://doi.org/10.1109/QoMEX.2015.7148151

STESCAL3D: Subjective evaluation of HD stereo video streaming using H.264 SVC in diverse laboratory environments. / Mysirlidis, Charalampos; Dagiuklas, Tasos; Rocha, Pedro M.R. et al.
2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015. Institute of Electrical and Electronics Engineers Inc., 2015. 7148151 (2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - STESCAL3D

T2 - 2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015

AU - Mysirlidis, Charalampos

AU - Dagiuklas, Tasos

AU - Rocha, Pedro M.R.

AU - Da Silva Cruz, Luis A.

AU - Kotaranin, Dino

AU - Gruicic, Savina

AU - Dumic, Emil

AU - Skodras, Athanassios

PY - 2015/7/2

Y1 - 2015/7/2

N2 - This paper presents a new 3D video database (STESCAL3D -Stereoscopic Scalable 3D), made up of 3D stereo video sequences affected by different types of degradations. A set of subjective quality grades have been collected in three geographically displaced sites. The database contents have been produced using scalable video coding to encode 3D stereo video clips with distinct encoding parameters, after which different transmission degradations have been applied to the encoded video streams. These sequences have been subjectively evaluated by observers from three countries, Croatia, Portugal and Greece, using a purpose-built web-based platform. The subjective quality data compiled were processed, analyzed and compared to quality estimates obtained using several well-known objective measures. It is shown that the correlation between objective quality estimates and the subjective quality grades is in general low. Additionally the results show that stereo-view asymmetries in terms of encoding parameters and packet loss ratio (PLR) leads to low quality of experience. The video database and the subjective grades collection are publicly available with the referral link provided in the text.

AB - This paper presents a new 3D video database (STESCAL3D -Stereoscopic Scalable 3D), made up of 3D stereo video sequences affected by different types of degradations. A set of subjective quality grades have been collected in three geographically displaced sites. The database contents have been produced using scalable video coding to encode 3D stereo video clips with distinct encoding parameters, after which different transmission degradations have been applied to the encoded video streams. These sequences have been subjectively evaluated by observers from three countries, Croatia, Portugal and Greece, using a purpose-built web-based platform. The subjective quality data compiled were processed, analyzed and compared to quality estimates obtained using several well-known objective measures. It is shown that the correlation between objective quality estimates and the subjective quality grades is in general low. Additionally the results show that stereo-view asymmetries in terms of encoding parameters and packet loss ratio (PLR) leads to low quality of experience. The video database and the subjective grades collection are publicly available with the referral link provided in the text.

KW - 3D video

KW - objective measures

KW - QoE

KW - STESCAL3D database

KW - subjective evaluation

UR - http://www.scopus.com/inward/record.url?scp=84939478172&partnerID=8YFLogxK

U2 - 10.1109/QoMEX.2015.7148151

DO - 10.1109/QoMEX.2015.7148151

M3 - Conference contribution

AN - SCOPUS:84939478172

T3 - 2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015

BT - 2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 26 May 2015 through 29 May 2015

ER -

Mysirlidis C, Dagiuklas T, Rocha PMR, Da Silva Cruz LA, Kotaranin D, Gruicic S et al. STESCAL3D: Subjective evaluation of HD stereo video streaming using H.264 SVC in diverse laboratory environments. In 2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015. Institute of Electrical and Electronics Engineers Inc. 2015. 7148151. (2015 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015). doi: 10.1109/QoMEX.2015.7148151

STESCAL3D: Subjective evaluation of HD stereo video streaming using H.264 SVC in diverse laboratory environments

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Cite this