A Tool for AR (Augmented Reality)-Assisted Surgery Based on 3D Digital Human Models


The augmented reality (AR) software tool to be developed in this study will rapidly and accurately map a virtual patient-specific 3D model to the actual patient on the surgery table and visualize the mapped model through an AR device. The patient-specific model will include 3D structures of the patient’s internal anatomy based on pre-operative medical images. The model will be tracked in real-time with modern computer vision technologies in the AR system. This AR tool will help surgeons rapidly locate important structures during time-critical stages of an operation while avoiding sensitive nerves and vessels.

People

Jingwen
Hu

UMTRI, ME
Engineering

Matthew
Reed

IOE, ISD, UMTRI
Engineering


Funding

Funding: $30K (2022)
Goal: Develop a software package that can accurately superimpose a 3D view of patient’s internal anatomy through a commercial AR device (Microsoft HoloLens) to a real patient during surgery.
Token Investors: Jingwen Hu, Matthew Reed


Project ID: 1026