AG: When you’re driving a car, you want to keep both hands on the steering wheel and your eyes on the road, not get distracted by looking at screens and having to press buttons. Similarly, when I’m working on a patient I want to keep my hands on my instruments and my eyes on the patient.
The concept we’ve developed with Microsoft allows me to see the real world superimposed with live data and 3D medical imagery needed to guide our precision therapy, and importantly also lets me control the procedure with voice recognition, eye tracking and advanced gestures.
HoloLens 2 is far more immersive than its predecessor, and much more intuitive to control. Rather than having to shift my focus away from the patient to press buttons, I can issue verbal commands, and the system can also recognize where I’m looking and what I’m doing with my hands. Together with Microsoft, we’re inventing an even better way for doctors to focus on the patient during minimally invasive procedures.
To get a better understanding of what this means in practice, take a look at this video of the concept.