Testing

Survey of web-based crowdsourcing frameworks for subjective quality assessment
The popularity of the crowdsourcing for performing various tasks online increased significantly in the past few years. The low cost and …
Tobias Hoßfeld, Matthias Hirth, Pavel Korshunov, Phillipe Hanhart, Bruno Gardlo, Christian Keimel, Christian Timmerer
PDF DOI
Survey of web-based crowdsourcing frameworks for subjective quality assessment
Best Practices for QoE Crowdtesting: QoE Assessment With Crowdsourcing
Quality of Experience (QoE) in multimedia applications is closely linked to the end users’ perception and therefore its …
Tobias Hoßfeld, Christian Keimel, Matthias Hirth, Bruno Gardlo, Julian Habigt, Klaus Diepold, Phuoc Tran-Gia
PDF DOI
Best Practices for QoE Crowdtesting: QoE Assessment With Crowdsourcing
Challenges in crowd-based video quality assessment
Video quality evaluation with subjective testing is both time consuming and expensive. A promising new approach to traditional testing …
Christian Keimel, Julian Habigt, Klaus Diepold
PDF DOI
Challenges in crowd-based video quality assessment
The TUM High Definition Video Data Sets
The research on video quality metrics depends on the results from subjective testing for both the design and development of metrics, …
Christian Keimel, Arne Redl, Klaus Diepold
PDF DOI
The TUM High Definition Video Data Sets
QualityCrowd -- A framework for crowd-based quality evaluation
Video quality assessment with subjective testing is both time consuming and expensive. An interesting new approach to traditional …
Christain Keimel, Julian Habigt, Clemens Horch, Klaus Diepold
PDF DOI
QualityCrowd -- A framework for crowd-based quality evaluation
Video quality evaluation in the cloud
Video quality evaluation with subjective testing is both time consuming and expensive. An interesting new approach to traditional …
Christian Keimel, Julian Habigt, Clemens Horch, Klaus Diepold
PDF DOI
Video quality evaluation in the cloud
On the use of reference monitors in subjective testing for HDTV
Most international standards recommend the use of reference monitors in subjective testing for visual quality. But do we really need to …
Christian Keimel, Klaus Diepold
PDF DOI
On the use of reference monitors in subjective testing for HDTV
Improving the prediction accuracy of video quality metrics
To improve the prediction accuracy of visual quality metrics for video we propose two simple steps: temporal pooling in order to gain a …
Christian Keimel, Tobias Oelbaum, Klaus Diepold
PDF DOI
Improving the prediction accuracy of video quality metrics