Review of Quantitative Empirical Evaluations of Technology for People with Visual Impairments

2020. Emeline Brulé, Brianna Tomlinson, Oussama Metatla, Christophe Jouffrais & Marcos Serrano
Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems.

Abstract

Addressing the needs of visually impaired people is of continued interest in Human Computer Interaction (HCI) research. Yet, one of the major challenges facing researchers in this field continues to be how to design adequate quantitative empirical evaluation for these users in HCI. In this paper, we analyse a corpus of 178 papers on technologies designed for people with visual impairments, published since 1988, and including at least one quantitative empirical evaluation (243 evaluations in total). To inform future research in this area, we provide an overview, historic trends and a unified terminology to design and report quantitative empirical evaluations. We identify open issues and propose a set of guidelines to address them. Our analysis aims to facilitate and stimulate future research on this topic.

Read the full paper here ›

Citation

Brulé, E., Tomlinson, B. J., Metatla, O., Jouffrais, C., & Serrano, M. (2020). Review of quantitative empirical evaluations of technology for people with visual impairments. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (pp. 1–14). New York, NY, USA: Association for Computing Machinery. URL: https://doi.org/10.1145/3313831.3376749, doi:10.1145/3313831.3376749

BibTeX

@inproceedings{10.1145/3313831.3376749,
author = {Brul\'{e}, Emeline and Tomlinson, Brianna J. and Metatla, Oussama and Jouffrais, Christophe and Serrano, Marcos},
title = {Review of Quantitative Empirical Evaluations of Technology for People with Visual Impairments},
year = {2020},
isbn = {9781450367080},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
url = {https://doi.org/10.1145/3313831.3376749},
doi = {10.1145/3313831.3376749},
abstract = {Addressing the needs of visually impaired people is of continued interest in Human Computer Interaction (HCI) research. Yet, one of the major challenges facing researchers in this field continues to be how to design adequate quantitative empirical evaluation for these users in HCI. In this paper, we analyse a corpus of 178 papers on technologies designed for people with visual impairments, published since 1988, and including at least one quantitative empirical evaluation (243 evaluations in total). To inform future research in this area, we provide an overview, historic trends and a unified terminology to design and report quantitative empirical evaluations. We identify open issues and propose a set of guidelines to address them. Our analysis aims to facilitate and stimulate future research on this topic.},
booktitle = {Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems},
pages = {1–14},
numpages = {14},
keywords = {assistive technology, education, evaluation methods, experiments, literature review, visual impairments},
location = {Honolulu, HI, USA},
series = {CHI '20}
}