Crowdsourcing evaluation of high dynamic range image compression

Philippe Hanhart; Pavel Korshunov; Touradj Ebrahimi

doi:10.1117/12.2065560

23 September 2014 Crowdsourcing evaluation of high dynamic range image compression

Philippe Hanhart, Pavel Korshunov, Touradj Ebrahimi

Proceedings Volume 9217, Applications of Digital Image Processing XXXVII; 92170D (2014) https://doi.org/10.1117/12.2065560
Event: SPIE Optical Engineering + Applications, 2014, San Diego, California, United States

Abstract

Crowdsourcing is becoming a popular cost effective alternative to lab-based evaluations for subjective quality assessment. However, crowd-based evaluations are constrained by the limited availability of display devices used by typical online workers, which makes the evaluation of high dynamic range (HDR) content a challenging task. In this paper, we investigate the feasibility of using low dynamic range versions of original HDR content obtained with tone mapping operators (TMOs) in crowdsourcing evaluations. We conducted two crowdsourcing experiments by employing workers from Microworkers platform. In the first experiment, we evaluate five HDR images encoded at different bit rates with the upcoming JPEG XT coding standard. To find best suitable TMO, we create eleven tone-mapped versions of these five HDR images by using eleven different TMOs. The crowdsourcing results are compared to a reference ground truth obtained via a subjective assessment of the same HDR images on a Dolby `Pulsar' HDR monitor in a laboratory environment. The second crowdsourcing evaluation uses semantic differentiators to better understand the characteristics of eleven different TMOs. The crowdsourcing evaluations show that some TMOs are more suitable for evaluation of HDR image compression.

Citation Download Citation

Philippe Hanhart, Pavel Korshunov, and Touradj Ebrahimi "Crowdsourcing evaluation of high dynamic range image compression", Proc. SPIE 9217, Applications of Digital Image Processing XXXVII, 92170D (23 September 2014); https://doi.org/10.1117/12.2065560

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available