AR and Navigation: the perfect medical tandem
Hololens 2 and RETINA pair up for a local medical demonstration in Taipei, Taiwan
The current global demand for cross-domain cooperation in the medical world has made some echo in a few companies from Taiwan. With the support of the Industrial Development Bureau of the Ministry of Economic Affairs, the Local Innovation Service Office of the Information Industry Development Association (Innovation Office of the Information Industry Association) and the Shuangho Hospital of the Ministry of Health and Welfare, EPED Inc., and GuaiYi Limited jointly planned and executed "Double Digital and Technological Application for the Smart Medical Field Presentation", which was launched on November 26 at the Shuangho Hospital of the Ministry of Health and Welfare in Taipei, Taiwan.
The technology introduced integrates Microsoft Hololens 2 Smart Glasses and RETINA: Stereotactic Surgery Navigation System, combining them with emerging technologies such as MR hybrid reality, Digital Twin, and medical resources to present the "Innovative Application of Medical Surgery Teaching".
At the scene, the guest list included Lin Junxiu, head of the Electronic Information Group of the Industrial Bureau of the Ministry of Economic Affairs, Wu Maisi, director of the Shuangho Hospital of the Ministry of Health and Welfare, Xiao Boren, director of the Digi+ Digital Economy Industry Promotion Office of the Ministry of Economic Affairs, and Hong Yuliang, Deputy Director of the Innovation Division of the Council of Information, personalities that witnessed and presented the new technology of "Innovative Application of Medical Surgery Teaching".
In the past, when performing minimally invasive endoscopic surgery to penetrate the skull base, or to perform a pituitary tumor resection, for example, the doctors needed to look up at the endoscope and tomographic 2D images on different screens, and compare the position of the endoscope in the 3D model, quite an inconvenient and risky action during any surgery. However, in the short run we can a Dicom file, manipulated with AI to build a digital file with clear soft/hard tissues exposure only by wirelessly connecting a navigation system to the Microsoft Hololens 2 smart glasses, and accurately positioning the relevant surgical instrumentation through the dynamic tracking system, providing virtual and real integrated navigation functions.
This technology can assist doctors during minimally invasive surgeries by directly presenting the 3D cross-sectional navigation map of the peripheral visual field of the affected area and real-time endoscopic images, avoiding unnecessary damage of blood vessels or other important soft tissues. It can also use gestures to control and switch screens improving the safety and success rate of every surgical procedure, while reducing risk, and postoperative consequences.
Xiao Boren, Director of the Digi+ Digital Economy Industry Promotion Office of the Ministry of Economic Affairs and Deputy Executive Director of the Information Technology Council, said that the Local Creation Service Office of the Information Technology Council is committed to promoting the digital transformation of industries and cross-field cooperation, especially affected by the epidemic this (2020) year.
The application of the double digital technology was published on November 26 day at the Shuangho Hospital of the Ministry of Health and Welfare to provide medical personnel with application experience.
Translated from the Institute for Information Industry's press release.