An Initial Investigation into Non-visual Code Structure Overview Through Speech, Non-speech and Spearcons

2018. Joe Hutchinson & Oussama Metatla
Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems.

Abstract

We investigate a novel, non-visual approach to overviewing object-oriented source code and evaluate the efficiency of different categories of sounds for the purpose of getting an overview of source code structure for a visually-impaired computer programmer. A user-study with ten sighted and three non-sighted participants compared the effectiveness of speech, non-speech and spearcons on measures of accuracy and enjoyment for the task of quickly overviewing a class file. Results showed positive implications for the use of non-speech sounds in identifying programming constructs and for aesthetic value, although the effectiveness of the other sound categories in these measurements are not ruled out. Additionally, various design choices of the application impacted results, which should be of interest to designers of auditory display, accessibility and education.

Read the full paper here ›

Citation

Hutchinson, J., & Metatla, O. (2018). An initial investigation into non-visual code structure overview through speech, non-speech and spearcons. Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (pp. 1–6). New York, NY, USA: Association for Computing Machinery. URL: https://doi.org/10.1145/3170427.3188696, doi:10.1145/3170427.3188696

BibTeX

@inproceedings{10.1145/3170427.3188696,
author = {Hutchinson, Joe and Metatla, Oussama},
title = {An Initial Investigation into Non-visual Code Structure Overview Through Speech, Non-speech and Spearcons},
year = {2018},
isbn = {9781450356213},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
url = {https://doi.org/10.1145/3170427.3188696},
doi = {10.1145/3170427.3188696},
abstract = {We investigate a novel, non-visual approach to overviewing object-oriented source code and evaluate the efficiency of different categories of sounds for the purpose of getting an overview of source code structure for a visually-impaired computer programmer. A user-study with ten sighted and three non-sighted participants compared the effectiveness of speech, non-speech and spearcons on measures of accuracy and enjoyment for the task of quickly overviewing a class file. Results showed positive implications for the use of non-speech sounds in identifying programming constructs and for aesthetic value, although the effectiveness of the other sound categories in these measurements are not ruled out. Additionally, various design choices of the application impacted results, which should be of interest to designers of auditory display, accessibility and education.},
booktitle = {Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems},
pages = {1–6},
numpages = {6},
keywords = {visualisation, sonification, programming, overview, accessibility},
location = {Montreal QC, Canada},
series = {CHI EA '18}
}