Medical VR Simulator for MedX.Pro.

Medical VR Simulator for MedX.Pro.

Customer

MedX.Pro is the largest portal for advanced training of doctors and healthcare professionals. Today, more than 35,000 doctors are trained there. Listeners and viewers have access to about 70 advanced training programs, several hundred lectures, broadcasts, additional materials, clinical recommendations, as well as tests to check acquired knowledge. Oncology is one of the most important areas of research. The total duration of educational programs from leading oncologists in Russia and the world is more than 1000 hours. Special attention in MedX.Pro is paid to nurses: together with the Ministry of Health of Russia, a series of courses for nurses is being developed, additional content is being created, for example, VR simulators that are closely related to practice.

Description

VR and AR technologies open up large-scale opportunities in the medical field. They provide savings in money and time, epidemiological safety, and most importantly, the active development of experience for young specialists in complex operations. The CT Simulator and Linac VR Simulator is a set of 3 introductory training courses for MedX. It provides young professionals with the basics of working with linear particle accelerators for the treatment of cancer patients.
The target audience of the project is divided into two categories:
• Medical professionals not necessarily in the field of oncology, who want to expand their knowledge of medical equipment and familiarize themselves with the process of delivering radiation therapy.
• Non-professional audience, who are indirectly involved in the decision-making processes in the field of procurement and maintenance of medical equipment.

The target audience of the project is divided into two categories:

Medical professionals are medical professionals, not necessarily in the field of oncology, who want to expand their knowledge of medical equipment and familiarize themselves with the process of delivering radiation therapy.
Non-professional audience — non-medical specialists who are indirectly related to the processes of acceptance of attitudes in the field of procurement and maintenance of medical equipment.

Challenge

The main task is to develop a VR simulator with 3 introductory courses for training medical professionals in virtual reality. Create realistic, animated 3D models of medical equipment located in the premises of medical institutions in conditions close to real.

Adapt VR simulator for formats:

Standalone application on the Oculus Quest 2 platform.
WebGL-module for integration into the educational platform on the website MedX.Pro

Solution

The VR simulator consists of 3 independent training courses lasting from 20 to 40 minutes. Each of them includes 3 components: narrative (theoretical knowledge of working with equipment), interactive (direct interaction of the user with the equipment) and testing of knowledge for successful completion of the course.

Navigation and control of the simulator are carried out by controllers of the Oculus Quest VR helmet in case of VR mode, and the mouse / keyboard in case of WebGL mode. For a more comfortable immerce and the effect of presence, we have developed an avatar of an autonomous flying helper bot. It also became a narrative assistant-narrator and conducted courses for users.

The mechanics of VR-simulator is divided into three stages:

The user puts on the VR helmet together with the controllers, then launches the application with the simulator from the main menu of the operating system.
Gets acquainted with the main interfaces of the application, then selects one of the 3 available training courses and starts its passage.
After completing the course, the user gets to the main menu, where he can choose another training course.

We have also developed 5 virtual spaces corresponding to the course functionality:

Computed tomography room.
Workplaces for oncologists and medical physicists.
Workplace of an oncologist, radiation therapy operator.
Radiation therapy room with Varian TrueBeam.
Radiation therapy room with Varian Halcyon.

To create the most reliable and realistic effect, we have carried out large-scale work on taking photos of real equipment, as well as inspected videos with experts, which have already created digital copies of medical devices.

Result

The VR simulator for MedX.Pro is a unique project in the field of medical education.

This is the kind of VR use case where healthcare professionals can not only get to know millions of dollars worth of equipment without damaging it, but also not take up hours of work, allowing their colleagues to save lives.

The simulator is available within the MedX.Pro platform on any Oculus Quest and Oculus Quest 2 via AppLab.

Yode Group team:

Samokhodkin Kirill — Creative Director

Andrey Ivashentsev — Innovation Director

Buchnev Alexey — Technical Director

Karachinets Dmitry — Art director, 3D modeler

Chernookov Anton — Project Manager

Sadriev Vladislav — UX/UI Designer, Mobile Interfaces

Akim Zaitsev — Mobile Developer

Sidelnikov Roman — Mobile Developer

Krasilova Natalia — 3D Artist, Animator

Polyakovich Mikhail — 3D Artist, Animator

Karchkov Vladimir — 2D designer, 3D Artist

Prikhodko Mikhail — Sound Designer