STUDY OF THE POSSIBILITIES OF USING AUGMENTED REALITY IN DENTISTRY
Maksalina Ikhvanovna Yusupova1, Kamilla Arturovna Mantikova1, Milana Aslanovna Kodzokova2, Artem Evgenevich Mishvelov3*, Alexandra Ivanovna Paschenko4, Zuleykha Abdulkerim Kizi Ashurova5, Rimma Hazbecherovna Slanova4, Sergey Nikolaevich Povetkin6
1 Department of Dentistry, Faculty of Dentistry, North Ossetian State Medical Academy, Vladikavkaz, Russian Federation.
2Department of Medicine, Faculty of Medicine, Kabardino-Balkar State University named after H.M. Berbekov, Nalchik, Russian Federation.
3Laboratory of 3D technologies, Stavropol State Medical University, Stavropol, Russian Federation. [email protected]
4 Department of Diagnostic, Stavropol Regional Clinical Consultative and Diagnostic Center, Stavropol, Russian Federation.
5Department of Medicine, Faculty of Medicine, Dagestan State Medical University, Makhachkala, Russian Federation.
6Department of Food Technology and Engineering, Institute of Life Sciences, North Caucasus Federal University, Stavropol, Russian Federation.
ABSTRACT
Using augmented reality glasses with the HoloDoctor program for implantological treatment, a new method of simulating implantological and surgical treatment in the maxillofacial region demonstrated good visualization of the anatomical features of the implant placement area, the possibility for the surgeon to carefully study the intervention area before the operation, performing surgery in the conditions of the real anatomy of the patient including the use of navigation in augmented reality, which allows us to practice the skills of operations on a virtual patient using phantom dummies (made using 3D printing) that are linked to holography in real-time. Computed jawbones tomography was performed. The impressions of antagonists and the lower jaw were obtained and plaster models were made from the impressions, and were later scanned. Implants were virtually installed with the help of the planning program and a 3D reconstruction of the image of the jaws was performed, and a template was designed. The model of the jaw and the template are printed on 3D scanners. According to the template and based on the accepted protocol, the implants were inserted into the plastic model.
Key words: 3D Scanner, Simulation system, Augmented reality glasses, Robotic-assisted surgery.
Introduction
Restoring defects in the maxillofacial region is an urgent modern dentistry problem [1-4]. Due to the various causes leading to the loss of hard and soft tissues of this area, the clinical picture can be very diverse, from a defect in a part of the tooth to extensive defects involving several anatomical formations of the maxillofacial and adjacent areas [5-8].
3D technologies allow us to eliminate the need to make calculations and drawings by hand and manual labor. Modern software allows us to see the model from all angles on the screen and eliminate the identified shortcomings not in the process of creation, as is the case with manual manufacturing [9, 10], but directly during the development and prototyping of the model [11-17]. At the same time, the possibility of inherent errors in manual work is practically excluded. Modern software for processing images obtained during cone-beam CT and MRI is supplied together with the devices. The functions of these programs are sometimes not enough to perform more complex work with the obtained data, including differentiation of tumors in various diseases [18-20].
Our previous scientific works [2, 21-32] showed the main shortcomings in this direction:
The solution is associated with the creation of a new type of simulation system for planning and navigating surgical interventions. The purpose of this work was to test in practice the methodology developed for planning and performing surgical interventions on the maxillofacial region with the assessed technology of additional reality.
Materials and Methods
To achieve this purpose, we developed an additional functional module for dentistry using augmented reality glasses. The module can help with the practice of operations on a virtual patient using phantom dummies (made using 3D printing) that are linked to holography in real-time. This technology in response to the actions of interns, not only shows the physiological parameters of the patient that are automatically changed, but also intraoperative, endosurgical, angiographic, and ultrasound images.
For this simulation technique, the PAX-i3D cone-beam computed tomography (CBCT) device with a FOV 10X8.5 (12X9) sensor and Ez3D-I software. The Avantis 3D implant treatment planning program, the 3Dison Multi 3D printer, and an out-of-mouth 3D scanner was used. For the diagnosis, specialized programs have been used that process the data of CBCT, allowing the diagnosis and subsequent planning of the operation. The planning system is based on computer data processing and the provision of information on the planning of the operation consists of the assessment of the state of the size and quality of bone tissue, the selection of a place for the installation of implants. This takes into account the location of the real teeth, the maxillary sinus, and the maxillary nerves.
The module for glasses developed by us is controlled by gestures, i.e. the medical specialist can point to the desired organ or instrument (tooth, surgical template), and remove it from the illustration. The software module interacts with the surgical dummy, using previously taken medical data of CT, MRI.
The simulator module allows the surgeon to make notes in the virtual treatment plan before the operation begins. The resulting image is transmitted to the augmented reality glasses (HoloLens).
The developed method was tested based on the Dolgalev Dental Clinic (Stavropol, Russia).
Results and Discussion
To test the developed method, we used the data of a 48-year-old patient who went to a Dolgalev Dental Clinic with complaints of difficulty chewing food, due to lack of chewing teeth in the lateral part of the lower jaw on the left. Diagnosis: partial loss of teeth, terminal defect of the lower jaw on the left. Treatment plan: installation of implants in the area of the teeth 3.6, 3.7.
Using the software, three-dimensional images were obtained and stereolithographic models were made of plastic, completely copying the anatomy of the patient's jawbones (Figures 1 and 2).
|
|
|
Figure 1. Cone-beam computed tomography data of the patient. |
|
|
|
Figure 2. 3D model of the upper jaw processed for a surgical intervention simulator. |
The obtained drawings and models allowed us to obtain complete information about the degree of atrophy of the bone tissue of the alveolar process, which significantly increases the accuracy of the implantation operation, as well as the prediction of the result of surgical intervention.
To simulate the process of implant placement, stereolytic plastic models of the jaws were made using DICOM files obtained using CBCT. The template was made according to the following method: the manufactured plaster models of the dentition were scanned using an extra-oral scanner and exported to a 3D template modeling program. This program allows you to superimpose a scanned model of the dentition in the form of STL files on a 3D reconstruction of the dentition obtained using CBCT. A 3D scene is created to model the template. The computer project is sent to a 3D printer, where a template is created that accurately displays the anatomy of the jaw area where the implants will be installed, and the correct position of the implant direction is already indicated on the anatomically verified template.
Conclusion
Computed jawbones tomography was performed. The impressions of antagonists and the lower jaw were obtained and plaster models were made from the impressions, and were later scanned. Implants were virtually installed with the help of the planning program and a 3D reconstruction of the image of the jaws was performed, and a template was designed. The model of the jaw and the template are printed on 3D scanners. According to the template and based on the accepted protocol, the implants were inserted into the plastic model.
The complex of additional reality can serve as a means of telemedicine, during the consultation of patients or surgical intervention.
Acknowledgments: The authors express their gratitude to Prof. Dr. Igor Baklanov for methodology and editing the article.
Conflict of interest: None
Financial support: None
Ethics statement: None
1. Galabueva AI, Biragova AK, Kotsoyeva GA, Borukayeva ZK, Yesiev RK, Dzgoeva ZG et al. Optimization of Modern Methods of Treating Chronic Generalized Periodontitis of Mild Severity. Pharmacophore. 2020;11(1):47-51.
2. Nagdalian AA, Rzhepakovsky IV, Siddiqui SA, Piskov SI, Oboturova NP, Timchenko LD, et al. Analysis of the Content of Mechanically Separated Poultry Meat in Sausage Using Computing Microtomography. J Food Compost Anal. 2021;100:103918.
3. Salins SS, Siddiqui SA, Reddy SVK, Kumar S. Experimental investigation on the performance parameters of a helical coil dehumidifier test rig. Energy Sources, A: Recover, Util, Environ Eff. 2021;43(1):35-53.
4. Salins SS, Siddiqui SA, Reddy SVK, Kumar S. Parametric Analysis for Varying Packing Materials and Water Temperatures in a Humidifier. Proceedings of the 7th International Conference on Fluid Flow, Heat and Mass Transfer (FFHMT’20), 2020. [online] Available from: https://avestia.com/FFHMT2020_Proceedings/files/paper/FFHMT_196.pdf.
5. Nuzhnaya KV, Mishvelov AE, Osadchiy SS, Tsoma MV, Slanova RH, Kurbanova AM, et al. Computer simulation and navigation in surgical operations. Pharmacophore. 2019;10(4):46-52.
6. Orsaeva AT, Tamrieva LA, Mischvelov AE, Osadchiy SS, Osipchuk GV, Povetkin SN, et al. Digital Clinic “Smart Ward”, Pharmacophore. 2020;11(1):142-6.
7. Asgari I, Soltani S, Sadeghi SM. Effects of Iron Products on Decay, Tooth Microhardness, and Dental Discoloration: A Systematic Review. Arch Pharm. Pract. 2020;11(1):60-82.
8. Hamed MT, Mously HA. Investigating Economic and Clinical Implications of Tooth Implant Supported Prosthesis among Patients and Practitioners. Int J Pharm Res Allied Sci. 2019;8(4):116-21.
9. Siddiqui SA, Ahmad A. Implementation of Newton’s Algorithm Using Fortran. SN Comput Sci. 2020;1(6):1-8. Available from: https://link.springer.com/article/10.1007/s42979-020-00360-3 [Accessed 18 Feb. 2021].
10. Siddiqui SA, Ahmad A. Implementation of Thin-Walled Approximation to Evaluate Properties of Complex Steel Sections Using C++. SN Comput Sci. 2020;1(6):1-11. Available from: https://link.springer.com/article/10.1007/s42979-020-00354-1 [Accessed 18 Feb. 2021].
11. Baklanov I, Rodionova V, Ivashova V, Shvachkina L, Medvedeva V. Social Trends for Increasing Satisfaction with the Educational Services of a Modern University. Calitatea. 2020;21(179):88-90.
12. Baklanov IS, Baklanova OA, Erokhin AM, Ponarina NN, Akopyan GA. Myth as a Means of Ordering and Organizing Social Reality. J Hist Cult Art Res. 2018;7(2):41-7.
13. Baklanov IS, Baklanova OA, Shmatko AA, Gubanova MA, Pokhilko AD. The Historical Past as a Factor of Sociocultural Transformations of Postmodernity. J Hist Cult Art Res. 2018;7(1):373-8.
14. Barabanov PV, Gerasimov AV, Blinov AV, Kravtsov AA, Kravtsov VA. Influence of nanosilver on the efficiency of Pisum sativum crops germination. Ecotoxicol Environ Saf. 2018;147:715-9.
15. Blinov AV, Yasnaya MA, Blinova AA, Shevchenko IM, Momot EV, Gvozdenko AA, et al. Computer quantum-chemical simulation of polymeric stabilization of silver nanoparticles. Physical and chemical aspects of the study of clusters nanostructures and nanomaterials. 2019;11:414-21.
16. Zimmerman T, Siddiqui SA, Bischoff W, Ibrahim SA. Tackling Airborne Virus Threats in the Food Industry: A Proactive Approach. Int J Environ Res Public Health. 2021;18(8):4335. doi:10.3390/ijerph18084335
17. Cheboi PK, Siddiqui SA, Onyando J, Kiptum CK, Heinz V. Effect of Ploughing Techniques on Water Use and Yield of Rice in Maugo Small-Holder Irrigation Scheme, Kenya. Agri Engineering. 2021;3(1):110-7. doi:10.3390/agriengineering3010007
18. Bledzhyants GA, Mishvelov AE, Nuzhnaya KV, Anfinogenova OI, Isakova JA, Melkonyan RS. The Effectiveness of the Medical Decision-Making Support System "Electronic Clinical Pharmacologist" in the Management of Patients Therapeutic Profile. Pharmacophore. 2019;10(2):76-81.
19. Blinova A, Blinov A, Baklanova O, Yasnaya M, Baklanov I, Siddiqui A, et al. Study of Wound-Healing Ointment Composition based on Highly Dispersed Zinc Oxide Modified with Nanoscale Silver. Int J Pharm Phytopharmacol Res. 2020;10(6):237-45. doi:10.51847/Cu6KX0JDE322.
20. Demchenkov EL, Nagdalian AA, Budkevich RO, Oboturova NP, Okolelova AI. Usage of atomic force microscopy for detection of the damaging effect of CdCl2 on red blood cell membrane. Ecotoxicol Environ Saf. 2021;208:111683.
21. Hight GY, Mishvelov AE, Melchenko EA, Nuzhnaya CV, Epanov VA, Dolgalev AA, et al. New Image Modeling Features For Planning Surgical Interventions. Res J Pharm, Biol Chem Sci. 2019;10 (1):140-3.
22. Hite GJ, Mishvelov AE, Melchenko EA, Vlasov AA, Anfinogenova OI, Nuzhnaya CV, et al. Holodoctor Planning Software Real-Time Surgical Intervention. Pharmacophore. 2019;10(3):57-60.
23. Kenijz NV, Koshchaev AG, Nesterenko AA, Omarov RS, Shlykov SN. Study the effect of cryoprotectants on the activity of yeast cells and the moisture state in dough. Res J Pharm Biol Chem Sci. 2018;9(6):1789-96.
24. Kubanov SI, Savina SV, Nuzhnaya CV, Mishvelov AE, Tsoroeva MB, Litvinov MS, et al. Development of 3d bioprinting technology using modified natural and synthetic hydrogels for engineering construction of organs. Int J Pharm Phytopharmacol Res. 2019;9(5):37-42.
25. Lopteva MS, Povetkin SN, Pushkin SV, Nagdalian AA. 5% Suspension of Albendazole Echinacea Magenta (Echinacea Purpurea) Toxicometric Evaluation. Entomol Appl Sci Lett. 2018;5(4):30-4.
26. Luneva A, Koshchayev A, Nesterenko A, Volobueva E, Boyko A. Probiotic potential of microorganisms obtained from the intestines of wild birds. Int Trans J Eng Manag Appl Sci Technol. 2020;11(12):11A12E
27. Lunin LS, Lunina ML, Kravtsov AA, Blinov AV. Effect of the Ag Nanoparticle Concentration in TiO2–Ag Functional Coatings on the Characteristics of GaInP/GaAs/Ge Photoconverters. Semiconductors. 2018;52(8):993-6.
28. Mezhidov BS, Belyaeva AA, Bimarzaev KSM, Bektashev AS, Shekhshebekova AM, Dzgoeva MG, et al. Prospects for Creating 3D Models of Internal Organs Based on Computer and Magnetic Resonance Imaging Images in Emergency Surgery and Resuscitation. Pharmacophore. 2021;12(1):8-14.
29. Nagdalian AA, Oboturova NP, Povetkin SN, Ziruk IV, Egunova A, Simonov AN, et al. Adaptogens Instead Restricted Drugs Research for An Alternative Items to Doping In Sport. Res J Pharm Biol Chem Sci. 2018;9(2):1111-6.
30. Shevchenko YS, Plohova DP, Bulakhova IN, Mishvelov AE, Kubalova ME, Badriev GB, et al. Experience of Carrying Out Magnetic Resonance Imaging with the Use of Specialized Protocols and Programs Computer Post-Processing. Pharmacophore. 2020;11(2):77-81.
31. Suleymanov TA, Kosinkova AM, Mishvelov AE, Povetkin SN, Simonov AN, Ziruk IV. Overview of the Holodoctor Software Package. Pharmacophore. 2020;11(2):65-72.
32. Siddiqui SA, Ahmad A. Dynamic Analysis of an Observation Tower Subjected to Wind Loads Using ANSYS. In: Proceedings of the 2nd International Conference on Computation, Automation and Knowledge Management (ICCAKM), Dubai, UAE, 19–21 January 2021; 6-11.
