Voice or Gesture in the Operating Room

Helena Mentis, Kenton O'Hara, Gerardo Gonzalez, Abigail Sellen, Robert Corish, Antonio Criminisi, Rikin Trivedi & Pierre Theodore. 2015.

Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems

This case study represents our efforts to investigate the uses of voice control versus gestural control in the OR. We present a system we expressly built to allow for both gestural or voice control at the choice of the surgeon. We explain our deployment of this system in the context of cardiothoracic surgery and present a vignette on how the system was used in the moment by the attending surgeon. We learn that, in terms of design, its not just a question of saying voice is better for one type of functionality and gesture is better for another; rather, the benefits are circumstantial. Thus, there is a case for building in redundancy in control with both voice and gesture.

Read the full paper here ›

Citation

Mentis, H. M., O'Hara, K., Gonzalez, G., Sellen, A., Corish, R., Criminisi, A., … Theodore, P. (2015). Voice or gesture in the operating room. Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (pp. 773–780). New York, NY, USA: Association for Computing Machinery. URL: https://doi.org/10.1145/2702613.2702963, doi:10.1145/2702613.2702963

BibTeX

@inproceedings{10.1145/2702613.2702963, author = {Mentis, Helena M. and O'Hara, Kenton and Gonzalez, Gerardo and Sellen, Abigail and Corish, Robert and Criminisi, Antonio and Trivedi, Rikin and Theodore, Pierre}, title = {Voice or Gesture in the Operating Room}, year = {2015}, isbn = {9781450331463}, publisher = {Association for Computing Machinery}, address = {New York, NY, USA}, url = {https://doi.org/10.1145/2702613.2702963}, doi = {10.1145/2702613.2702963}, abstract = {This case study represents our efforts to investigate the uses of voice control versus gestural control in the OR. We present a system we expressly built to allow for both gestural or voice control at the choice of the surgeon. We explain our deployment of this system in the context of cardiothoracic surgery and present a vignette on how the system was used in the moment by the attending surgeon. We learn that, in terms of design, its not just a question of saying voice is better for one type of functionality and gesture is better for another; rather, the benefits are circumstantial. Thus, there is a case for building in redundancy in control with both voice and gesture.}, booktitle = {Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems}, pages = {773–780}, numpages = {8}, keywords = {gesture, operating room, voice control}, location = {Seoul, Republic of Korea}, series = {CHI EA '15} }