Augmented reality: this is how the VR glasses penetrated the world of medicine

In 2014, Facebook acquired a small company called “Oculus Rift” that developed virtual reality glasses for gamers. Two years later, marketing of virtual reality glasses began as a leisure and entertainment accessory, mainly for computer game enthusiasts. During the corona lockdowns, the popularity of the VR glasses accelerated: the graphics and speed were significantly improved and made it possible to add experiential apps that turned the living room into a movie theater, a gym, or the top of a snowy mountain. In recent years, augmented reality technology has also revolutionized the world of medicine and health with new and advanced applications in hospitals and clinics around the world.

Israel is one of the powerhouses in the use of technology in the healthcare field, and within a few years it is likely that almost all of us will be able to experience technology for pain relief, emotional relief in psychological therapy, physical therapy training, or just a conversation with a virtual doctor who will seem really close to us.

For those who are not familiar, augmented reality technology, Virtual Reality includes glasses that allow the user to enter an artificial virtual world and experience an interactive and immersive experience. The glasses work with a combination of several key technologies: small displays that are placed in front of the eyes and display 3D images. Each eye receives a slightly different image, which creates a sense of depth and three-dimensionality, with a high resolution that allows the user to seemingly assimilate into the situation. The glasses also contain sensors that allow the system to detect the user’s head and eye movements and react along with them. The advanced glasses come with external sensors that also track body and hand movements. The user can grab objects, press buttons, and assimilate into the virtual reality.

One of the main uses in the world of medicine for the VR glasses is in the field of mental health: the health funds and medical centers in Israel have begun to use these glasses as part of the emotional and psychological treatment. “The use of virtual reality helps to be used as a technological aid that expands the mental treatment,” explains Efi Gil, a medical psychologist at Klalit Health Services and one of the pioneers of implementing technology in the field of mental health in Israel, “virtual reality glasses can be used today to overcome phobias by means that we did not have in the past, to help in phobias, reduce pain, treat anxiety, depression and post-trauma.” Gil suggests that patients use a technique that has been proven in many studies to help the psychotherapy process.

The Sheba Medical Center is among the most active in the field of virtual reality: in the hospital, they established an augmented reality development department, where they create applications that prepare the medical teams for procedures and treatments, one of which is simulations for operating room nurses that allow them to practice assisting the surgeons in presenting the instruments and treating the patient. “The simulations respond to the nurse’s actions,” explains Maor Bar, director of augmented reality development at the hospital, “the nurse can practice, be tested and receive feedback on her work. The instructor also receives feedback on her work, and can help her improve in areas that need improvement.”

At Sheba they have developed additional technologies that are used in the various departments to improve the condition of the patients. For example, in the physiotherapy institutes, the VR glasses are used to improve range of motion and help the injured in the rehabilitation process. In the geriatric wards, patients are allowed to improve their motor skills and cognitive tasks. The glasses are also used to reduce anxiety among hospitalized children, and those undergoing procedures that require blurring such as a colonoscopy.

“Augmented reality has a powerful power that helps patients,” explains Prof. Amitai Ziv, director of the Rehabilitation Hospital and founder of the Center for Medical Simulations at the Sheba Medical Center, “the glasses make it possible to provide the patient with a fascinating environment that makes him forget his anxieties and fears, improves his responsiveness before procedures that may cause him anxiety and fear, helps with motor and cognitive rehabilitation and also allows medical teams to be trained before operations that require great and precise skill. This is undoubtedly a work environment that still needs to be improved, but it will allow patients to be assisted at any time, anywhere, with great precision and accurate feedback.”

The virtual reality glasses are also used to train the doctors of the future: at the Faculty of Medicine of Bar Ilan University in Safed, the medical students receive classes in which they observe scenarios in front of patients, and are required to show empathy in various extreme situations.

At the Meir Medical Center in Kfar Saba, virtual reality glasses have been used for several years in the children’s division with the aim of reducing anxiety and giving them a sense of control over the situation. Among other things, glasses are used there while putting in an infusion, changing dressings, sewing up an incision, injections and treatments. The use of the virtual reality glasses, the hospital explains, is not suitable for everyone, and there are children who actually have a hard time letting go of control and want to be present during the operation. However, the use of glasses was able to reduce the need for opacifying drugs, which also reduced the length of stay in the hospital.

The Hillel Yaffe hospitals in Hadera, the Emek in Afula and Hadassah in Jerusalem also use the VR glasses to treat children who come to pediatric emergency rooms for a variety of procedures that involve pain and discomfort. “The children are enthusiastic about the new world that has been exposed to them” says Esnat Naor, a nurse in charge of sorting children in the valley, “this makes the whole experience better for the child, the parents and of course for us, the caregivers.” The children who need a cast are also helped by the virtual reality glasses. “The children are more relaxed and happy to cooperate” says Avi Cohen, the Hebsen who takes care of the children, “the children remember the operation as a fun experience and not as a trauma.” At the Hadassah Hospital, the use has been extended to include children who need MRI imaging, an operation that takes a long time and requires lying down without moving in the huge metal tunnel. The child practices the imaging scenario, and when the medical team notices that he is able to lie down without moving, approval is given to perform the imaging.

“The VR devices will improve both in terms of computer processing and graphics capabilities, will be smaller and lighter, and will design new exposure environments that will be adapted to each specific patient,” concludes medical psychologist Efi Gil, “if, for example, a person feels that the place that relaxes him is the beach in Thailand, we can design a beach that contains the elements that calm him like the smell of the sea, so that the feeling of assimilation will be more realistic. It is possible that the artificial intelligence will make it possible to create an avatar that looks like a real person, and the virtual character will be able to help the patient even without the presence of a psychologist. However, this will always be another auxiliary technology, which will never It will replace the special interpersonal relationship created in the therapeutic session.”