Visualisation and manipulation of 3D patient-specific bone geometry using augmented reality
| dc.contributor.advisor | Mutsvangwa, Tinashe | |
| dc.contributor.advisor | Douglas, Tania | |
| dc.contributor.advisor | Bracio, Boris R | |
| dc.contributor.author | Coertze, Johannes A | |
| dc.date.accessioned | 2020-09-10T08:36:44Z | |
| dc.date.available | 2020-09-10T08:36:44Z | |
| dc.date.issued | 2020 | |
| dc.date.updated | 2020-09-10T08:36:22Z | |
| dc.description.abstract | Computer-mediated reality technologies have the potential to improve the imageguided surgery (IGS) workflow; specifically, pre-surgical planning, intra-operative guidance, post-surgical assessment, and rehabilitation. Augmented reality (AR), a form of computer-mediated reality, uses an electronic display or projection module to add a hologram in the user's field of view (FOV). For intra-operative guidance, AR could aid in reducing the cognitive overload experienced by clinicians due to integrating multi-modal imaging data from several sources while performing the intervention on the patient. Three AR HMD systems have been developed to explore the capabilities of the Microsoft HoloLens as an AR HMD to be used in developing an AR HMD medical system. The three AR HMD systems required different software and hardware system architectures, however, each of the AR HMD system's software applications has been developed in Unity combined with the Mixed Reality Toolkit (MRTK). Each of the AR HMD systems implemented different registration techniques to localize the virtual object in the real-world coordinate system. The registration techniques were user calibration alignment to identified anatomical landmarks, fiducial marker tracking, and markerless tracking. For user calibration with anatomical landmarks, the MRTK was manipulated to allow alignment of the virtual object. For fiducial registration, the Vuforia Software Development Kit (SDK) was added to assess the alignment and spatial anchoring of the virtual object as specified. Finally, the Leap Motion Controller (LMC) and Leap's Orion SDK was used for exploring markerless tracking. The AR HMD systems developed enabled performance assessments, and alignment errors were identified during trials of the three systems. Most notably the location drift of the 3D virtual object in the spatial space due to the clinician moving around the registered location. This project entailed preliminary development towards the AR HMD medical system to create an in-vivo view of 3D patient-specific bone geometries as a hologram in the clinician's FOV. | |
| dc.identifier.apacitation | Coertze, J. A. (2020). <i>Visualisation and manipulation of 3D patient-specific bone geometry using augmented reality</i>. (). ,Faculty of Health Sciences ,Division of Biomedical Engineering. Retrieved from http://hdl.handle.net/11427/32211 | en_ZA |
| dc.identifier.chicagocitation | Coertze, Johannes A. <i>"Visualisation and manipulation of 3D patient-specific bone geometry using augmented reality."</i> ., ,Faculty of Health Sciences ,Division of Biomedical Engineering, 2020. http://hdl.handle.net/11427/32211 | en_ZA |
| dc.identifier.citation | Coertze, J.A. 2020. Visualisation and manipulation of 3D patient-specific bone geometry using augmented reality. . ,Faculty of Health Sciences ,Division of Biomedical Engineering. http://hdl.handle.net/11427/32211 | en_ZA |
| dc.identifier.ris | TY - Master Thesis AU - Coertze, Johannes A AB - Computer-mediated reality technologies have the potential to improve the imageguided surgery (IGS) workflow; specifically, pre-surgical planning, intra-operative guidance, post-surgical assessment, and rehabilitation. Augmented reality (AR), a form of computer-mediated reality, uses an electronic display or projection module to add a hologram in the user's field of view (FOV). For intra-operative guidance, AR could aid in reducing the cognitive overload experienced by clinicians due to integrating multi-modal imaging data from several sources while performing the intervention on the patient. Three AR HMD systems have been developed to explore the capabilities of the Microsoft HoloLens as an AR HMD to be used in developing an AR HMD medical system. The three AR HMD systems required different software and hardware system architectures, however, each of the AR HMD system's software applications has been developed in Unity combined with the Mixed Reality Toolkit (MRTK). Each of the AR HMD systems implemented different registration techniques to localize the virtual object in the real-world coordinate system. The registration techniques were user calibration alignment to identified anatomical landmarks, fiducial marker tracking, and markerless tracking. For user calibration with anatomical landmarks, the MRTK was manipulated to allow alignment of the virtual object. For fiducial registration, the Vuforia Software Development Kit (SDK) was added to assess the alignment and spatial anchoring of the virtual object as specified. Finally, the Leap Motion Controller (LMC) and Leap's Orion SDK was used for exploring markerless tracking. The AR HMD systems developed enabled performance assessments, and alignment errors were identified during trials of the three systems. Most notably the location drift of the 3D virtual object in the spatial space due to the clinician moving around the registered location. This project entailed preliminary development towards the AR HMD medical system to create an in-vivo view of 3D patient-specific bone geometries as a hologram in the clinician's FOV. DA - 2020_ DB - OpenUCT DP - University of Cape Town KW - Biomedical Engineering LK - https://open.uct.ac.za PY - 2020 T1 - Visualisation and manipulation of 3D patient-specific bone geometry using augmented reality TI - Visualisation and manipulation of 3D patient-specific bone geometry using augmented reality UR - http://hdl.handle.net/11427/32211 ER - | en_ZA |
| dc.identifier.uri | http://hdl.handle.net/11427/32211 | |
| dc.identifier.vancouvercitation | Coertze JA. Visualisation and manipulation of 3D patient-specific bone geometry using augmented reality. []. ,Faculty of Health Sciences ,Division of Biomedical Engineering, 2020 [cited yyyy month dd]. Available from: http://hdl.handle.net/11427/32211 | en_ZA |
| dc.language.rfc3066 | eng | |
| dc.publisher.department | Division of Biomedical Engineering | |
| dc.publisher.faculty | Faculty of Health Sciences | |
| dc.subject | Biomedical Engineering | |
| dc.title | Visualisation and manipulation of 3D patient-specific bone geometry using augmented reality | |
| dc.type | Master Thesis | |
| dc.type.qualificationlevel | Masters | |
| dc.type.qualificationlevel | MSc |