The effect of display capabilities on the gloss consistency between real and virtual objects

1Max-Planck-Institut für Informatik 2Intel Corporation 3University of Cambridge 4ISTA
5Universita della Svizzera Italiana 6Universidad de Zaragoza, I3A
*Both authors contributed equally

A faithful reproduction of gloss is inherently difficult because of the limited dynamic range, peak luminance, and 3D capabilities of display devices. This work investigates how the display capabilities affect gloss appearance with respect to a real-world reference object. To this end, we employ an accurate imaging pipeline to achieve a perceptual gloss match between a virtual and real object presented side-by-side on an augmented-reality high-dynamic-range (HDR) stereoscopic display, which has not been previously attained to this extent. Based on this precise gloss reproduction, we conduct a series of gloss matching experiments to study how gloss perception degrades based on individual factors: object albedo, display luminance, dynamic range, stereopsis, and tone mapping. We support the study with a detailed analysis of individual factors, followed by an in-depth discussion on the observed perceptual effects. Our experiments demonstrate that stereoscopic presentation has a limited effect on the gloss matching task on our HDR display. However, both reduced luminance and dynamic range of the display reduce the perceived gloss. This means that the visual system cannot compensate for the changes in gloss appearance across luminance (lack of gloss constancy), and the tone mapping operator should be carefully selected when reproducing gloss on a low dynamic range (LDR) display.

Downloads

Paper [PDF ~32 MB]
Paper [PDF ~44 MB]
Project Website

Citation

Bin Chen, Akshay Jindal, Michal Piovarci, Chao Wang, Hans-Peter Seidel, Piotr Didyk, Karol Myszkowski, Ana Serrano, Rafal K. Mantiuk, The effect of display capabilities on the gloss consistency between real and virtual objects, SIGGRAPH Asia Conference Papers (2023)

@inproceedings{Condor2023,
  author = { Bin Chen and Akshay Jindal and Michal Piovar\v{c}i and Chao Wang and Hans-Peter Seidel and Piotr Didyk and Karol Myszkowski and Ana Serrano and Rafal K. Mantiuk},
  title = {The effect of display capabilities on the gloss consistency between real and virtual objects},
  booktitle = {SIGGRAPH Asia 2023 Conference Papers},
  year = {2023},
}

Acknowledgements

This work is supported by FWF Lise Meitner (Grant M 3319), Span- ish Agencia Estatal de Investigación (project PID2022-141539NB- I00), European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agree- ment N◦ 725253–EyeCode), Swiss National Science Foundation (Grant no. 200502), and academic gifts from Meta. We thank Dmitry Lubyako and Ali Özgür Yöntem for building the turntable for our experiment.

Collaborations