Enhancing Mixed Reality Simulation Training Technology with Real-Time Performance Visualization: Mixed Methods Study with Medical First Responders

Background: Mixed Reality (MR) simulation training is emerging in paramedical education for practicing stress-intensive scenarios like mass casualty incidents in a safe and controlled environment. Current training platforms, however, lack real-time stress and human performance monitoring tools.
Objective: The study aims to enhance mixed reality training for medical first responders through real-time evaluation of performance and stress levels, leveraging bio-signal monitoring and advanced analytics to allow instructors to tailor feedback and maintain optimal challenge and safety levels.
Methods: The study includes a structured, multi-phase approach including initial requirement gathering (structured interviews and co-creation workshops), an online design survey, iterative prototype development to a field trial (including training observations and interviews). Data was collected from five end-user consortium members across Europe.
Results: End-users emphasized the need for user-friendly, cost-effective MR training that enhances outcomes and safety, with expectations for improved efficiency, engagement and the ability to assume various roles in simulations. The study identified critical training aspects and performance metrics, incorporated real-time Key Performance Indicators monitoring including stress levels and conducted field trials demonstrating the MR system's efficacy in improving Mass Casualty Incidents training through detailed feedback and adaptive scenario management.
Conclusions: This research enhances MR training for paramedics by integrating real-time performance metrics and stress indicators, based on a human-centered design approach that aligns with end-user needs, thereby setting a foundation for developing more effective and immersive training solutions for high-stress professions.