Leveraging AI for Immersive Medical Training Environments

SoarTech’s mission is to solve as many of the military’s toughest problems as possible. Some of those most critical ones include those problems within the medical domain. Our portfolio of medical efforts continues to grow as we tackle tough issues in both the training and operational applications. We develop immersive simulation environments that leverage physiology models to provide life-like scenarios for training.

With this capability and others, we aim to increase student throughput while decreasing instructor workload in various applications. Using our SpeechZero® capability, we work to support and find efficiencies with C-CHAT for teaching and improving patient handoff training, which increases the ability to save lives in the field.

From an operational standpoint, we leverage SoarTech’s EpEx® capability, and a clinical decision support system, known as ISAAC. With this effort, we hope to give novice medical providers or those with basic medical training, an AI that will not only provide a diagnosis for injuries in the field but provide guidance for intervention and treatment when other support and evacuation methods are not available.

SoarTech’s Big Picture Approach

SoarTech hasn’t always focused on medical, however while solving many of the military’s toughest problems in other domains, we’ve been able to pull in expertise and apply many solutions into the medical domain. We encourage a cyclical mindset of development so when we identify something in the training domain that can be translated to a solution for the operational environment, we act on it. Leveraging our experience allows us to integrate intelligent training capabilities into operational systems, and rich data from the operational environment allows us to refine our system(s) and improve the feedback, which allows us to evolve to meet our users’ needs.

Our team has a wide range of education and experience, from human factors to AEP, as well as hospital practitioners experienced in the robotic surgery domain. The team brings a robust and unique perspective on how we are solving today’s problems in medical RDT&E. Using a fact-based approach, we find realistic solutions that are practical, reasonable, and valuable to the user, yet still push the envelope. Most important, we create innovative AI-driven solutions our medical end-users can trust.

Our capabilities leverage over 20 years of AI development here at SoarTech and span from the training and operational domains. We are committed to creating solutions that are tailored to our users, provide realistic material, and reduce instructor workload. This includes augmenting a provider’s skillset to improve a patient’s experience and increase their survivability, for example, keeping good documentation.

Our solutions are designed to enable a provider to transcend their skills to provide optimal experiences in the continuum of patient care.  Creating an environment for patients to get better care and providing a tool for instructors to be able to support that goal. Provided data is used to populate and analyze ERH, and provide recommendations to practitioners and patients.

We use many available technologies in combination with our proprietary capabilities and software to make inroads for better decision-making support tool for AR/VR, for example, Microsoft HoloLens, Pulse Physiology Model, DuJo, Physiology sensors, and Android Devices.

C-CHAT

Improving patient handover communications training

Casualty care requires several patient handoffs to personnel throughout the continuum of care. These handoffs require a complete and detailed exchange of patient information. C-CHAT uses SoarTech’s domain-specific speech recognition and intent modeling capability to train, assess, and facilitate vital verbal communications

  • Instructors deploy systems for use in Tier 1+ training for independent practice in the classroom without the need for constant oversight, freeing up time for instructors to help students on higher order tasks, and for more practice on demand.

  • The diagnostics and assessment capabilities of the system allow for instructors to focus on problem areas that need more interactive feedback and instruction.

  • The advanced speech recognition tool is capable of supporting the training and assessment of combat casualty handoffs.

  • C-CHAT is a modular, extensible, and scalable tool permitting verbal-based training, synthetic roleplaying, and automated assessment of critical medical communication skills.

  • Uses an advanced Natural Language Processing (NLP) capability coupling both speech recognition and speech intent modeling tools to support operational and training needs.

  • Enables the training of critical handoff communication skills through an anytime/anywhere platform that supports trainers through simulated role-players and objective evaluation and automated scoring.

ISAAC

Providing a helping hand in diagnosing and treatment when expert help is not around.

ISAAC diagnosis and intervention system is a clinical decision support (CDS) system intended to aid novice users in caring for casualties in the field when other support is not available. It employs SoarTech’s EpEx® to pull in sensor data, understand it, and explain what is occurring. Analyzing that information, the system recommends suggested interventions/treatments based on the care providers skill level and access to supplies. A knowledge system, ISSAC supports available medical personnel with diagnoses and interventions multiplying the efficacy of available medical personnel

  • ISAAC diagnosis and intervention system is a clinical decision support (CDS) system intended to aid novice users in caring for casualties in the field when other support is not available. It employs SoarTech’s EpEx® to pull in sensor data, understand it, and explain what is occurring. Analyzing that information, the system recommends suggested interventions/treatments based on the care providers skill level and access to supplies. A knowledge system, ISSAC supports available medical personnel with diagnoses and interventions multiplying the efficacy of available medical personnel

  • The amalgam of a Causal AI medical diagnosis system and an integrated personnel, supply, and expertise management system that provides reasonable and executable intervention recommendations, ISAAC is a medical force multiplier extending expertise for diagnosis and intervention.

  • Tracks symptoms, observations, and physiological feeds to feed a causal inference engine and arrive at plausible medical diagnoses, as well as available supplies and personnel expertise to recommend actionable medical interventions.

  • ISAAC is a knowledge system which supports available medical personnel with diagnoses and interventions multiplying the efficacy of available medical personnel.

C3ARESYS

Adding augmented realism to Combat Casualty Care training

Combat Casualty Care (C3) training typically involves instructors providing scenario elements including verbally declaring pulses/blood pressures, spraying simulated blood on trainees, or declaring scenario-specific observations (second wounds, broken bones).

C3ARESYS is a Combat Casualty Care part task trainer with content delivery provided via the HoloLens 2 augmented reality (AR) system and provides each of these elements in an immersive AR environment to free instructors to observe, instruct, and assess trainees.

  • C3ARESYS can be integrated SoarTech’s speech recognition, gesture recognition, and stealth assessment capabilities to facilitate many scenarios.

  • Leverages the most modern iteration of the HoloLens AR platform, integrates with SoarTech’s in-house speech recognition systems, and uses the Pulse Physiology Engine to model realistic responses from a simulated patient.

  • Provides point of need Combat Casualty Care training in an immersive method that reduces the workload for instructors.

  • Allows students the ability to immerse themselves in an augmented reality training system that overlays data-driven simulated signs and symptoms of injuries, illnesses, etc. using unique environmental markers.

What Domains Can It Impact?

  • Medical instructors/facilitators

  • Military and civilian first responders

  • EMTs

  • C3 medics

  • Novice medical providers

Proven Use-Cases

  • Combat tactical care applications
  • Field and operational applications

  • Class training/instructor support systems

LET’S BEGIN A CONVERSATION

Learn more about our company or share your contact information so we can engage in conversation.