Voice or Gesture in the Operating Room

2015. Helena Mentis, Kenton O'Hara, Gerardo Gonzalez, Abigail Sellen, Robert Corish, Antonio Criminisi, Rikin Trivedi & Pierre Theodore
Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems.

Abstract

This case study represents our efforts to investigate the uses of voice control versus gestural control in the OR. We present a system we expressly built to allow for both gestural or voice control at the choice of the surgeon. We explain our deployment of this system in the context of cardiothoracic surgery and present a vignette on how the system was used in the moment by the attending surgeon. We learn that, in terms of design, its not just a question of saying voice is better for one type of functionality and gesture is better for another; rather, the benefits are circumstantial. Thus, there is a case for building in redundancy in control with both voice and gesture.

Read the full paper here ›