RESEARCH PAPER

Digital hearts – analysis of 3D segmented medical images with the use of Microsoft HoloLens

The analysis of medical images in the form of segmentation plays a key role in the preoperative patient’s assessment undertaken in clinics around the world. Planning treatments based on precise body models allows for better understanding of complex and unique human anatomy which reduces the risk of complications. Frequent outcomes in the form of computer visualization or 3D printing have their limitations such as high costs of printing materials, narrow sensory activation or restricted approach to individual compounds. In our opinion, present development of mixed-reality could help the process both before and during the procedure by creating an innovative refinement. Our case-report aims to validate mixed-reality using Microsoft HoloLens 2 based on 3D medical imaging segmentation. In order to demonstrate the versatility and potential of this multisensory integration method, two independent 3D cardiac models with comorbid cardiovascular defects have been prepared with the use of specialized graphic software. The obtained angio-CT examinations of the patient’s thorax with various cardiovascular pathologies were subjected to the process of manual segmentation with particular emphasis on the flow of the marker through the heart and vessels. Based on CT raw data, semi-automatic heart segmentation of two medical cases has been performed. Each case was developed with the help of a different program – Mimics Medical and 3D Slicer. Quality of the image data needed to perform the segmentation to a large degree determines the outcomes. The distortions caused by numerous factors have been smoothed out with the estimation of the proper boundaries of the given structures. Additionally, selected thoracic structures have been specified to establish the location and mutual relations of individual organs. Creating the models, special emphasis was put on the details to maintain the highest possible diagnostic value. The use of mixed-reality enables multi-sensory activation and expanded interaction with the medical model in an advanced way that allows for even more detailed exploration of the multi-faceted structure of the medical models. Future investigations are pivotal to deliver superior user experience.