SARA: Surgical Augmented Reality Assistance
Surgical Augmented Reality Assistance
The SARA project investigated the use of augmented reality to overlay a 3D rendering of medical images and planning information onto the patient’s anatomy during neurosurgery and orthopedic surgery to enhance the Computer Assisted Surgery (CAS) experience.
Reducing cognitive pressure on surgeons
CAS solutions provide anatomical references to surgeons as well as planning information such as cutting lines and resection boundaries and may automatically update based on the positions of tools or pointers. However, surgeons must look away from the patient to a nearby display and mentally align the visualized 2D structures with what they see on the table. Augmented reality overcomes this issue by projecting information directly onto the surgeon’s field of vision.
Based on available technologies
The SARA consortium is composed of members with expertise in medical imaging and 3D modeling, augmented reality, surgical technology and training models and integrated operating rooms. They will use the Microsoft Hololens to explore the use of AR in surgical training, planning and execution.
Prioritizing the needs of the surgical team
SARA developed the following tools and components:
- A pipeline that enables the accurate separation of anatomical structures in neurosurgery and orthopedic surgery;
- Voice or gesture-controllable high-quality rendering apps for wall-mounted displays and head-mounted devices for training, planning, visualization and surgical navigation;
- A protocol for the evaluation of the AR experience and user needs of the surgical team.
- Clinically-validated demonstrators
The SARA project resulted in several demonstrators for the use of AR apps in multiple surgical contexts. Detailed requirements lists, control recommendations and accuracy and reliability analyses will be produced as well. In addition, the feasibility of AR in surgery was evaluted in view of future applications, as will surgeons’ views and attitudes on the use of AR in the operating room.
“The SARA project investigated the use of augmented reality to overlay a 3D rendering of medical images and planning information onto the patient’s anatomy during surgery. The aim an enhanced computer-assisted surgery experience and reduced cognitive pressure on surgeons were reached.”
Lees meer in dit artikel op VUB Today or the imec website
