Communications training system

Inventors

Sullivan, KevinRoberts, MatthewKnapp, MichaelRiordan, Brian

Interested in licensing this patent?

MTEC can help explore whether this patent might be available for licensing for your application.

Assignees

Aptima Inc

Member
Aptima, Inc.
Aptima, Inc.

Aptima, Inc. is a leader in optimizing and improving human performance in mission-critical, technology-intensive environments. Since 1995, Aptima has combined social science principles with advanced computational methods to deliver innovative, human-centered engineering solutions for defense, intelligence, aviation, law enforcement, and healthcare sectors. The company is recognized for its multidisciplinary approach, integrating expertise from engineering, data science, psychology, and cognitive science to address complex challenges. Aptima is committed to advancing research and development in artificial intelligence, machine learning, data analytics, and simulation, with a strong focus on enhancing human-machine teaming, learning, and readiness. Their mission is to ensure synergy between humans, technology, and organizations, accelerating learning and productivity in the age of AI. Aptima's culture is rooted in innovation, impact, and empathy, fostering an inclusive and supportive environment for its diverse team of experts.

Publication Number

US-11557217-B1

Patent

Publication Date

2023-01-17

Expiration Date


Abstract

A communications training system is provided having a user interface, a computer-based simulator and a performance measurement database. The user interface is configured to receive a speech communication input from the user based on a training content and the computer-based simulator is configured to transform the speech communication to a text data whereby the text data can be aligned to performance measurement database values to determine a performance measure of the speech communication. The format of the text data and the performance measurement database values enable the speech communication to be aligned with predefined performance measurement database values representing expected speech communications for that training content.

Core Innovation

A communications training system is provided having a user interface, a computer-based simulator and a performance measurement database. The user interface is configured to receive a speech communication input from the user based on a training content and the computer-based simulator is configured to transform the speech communication to a text data whereby the text data can be aligned to performance measurement database values to determine a performance measure of the speech communication. The format of the text data and the performance measurement database values enable the speech communication to be aligned with predefined performance measurement database values representing expected speech communications for that training content.

Embodiments of the disclosed communications training systems and methods of their use enable an individual student to practice communications and coordination in individual or teaming scenarios by incorporating synthetic entities and natural language processing into simulators/trainers that emulate voice and chat interactions, without requiring live pilots and other participants. The systems and methods incorporate a system architecture that predefines system elements such that training events may be presented to a system user and the system can capture responses in a manner that allows for accurate understanding of the state of the student and accurate measurement of the student's performance. The system architecture may include data storage and retrieval format to enable this measurement.

The systems and methods include processor or computer-based simulators that include features for natural language processing that can evaluate student teamwork and communications for completeness, accuracy, order, brevity, and timeliness of the interactions to enhance their learning. The systems and methods may also automate objective performance measurements without the need for live observation and may provide instructors with detailed assessments of the student for feedback and after action reviews. The systems and methods may store training session data for replay by the student and the instructor and include feedback modules that show instructor and trainee progress and trends and allow adjustment of training curriculum.

Claims Coverage

Three independent claims were identified. The following inventive features extract the main inventive elements explicitly recited in those independent claims.

Memory storing training content with event type and simulation data

A memory configured to store a training content data set comprising a training event data, the training event data comprising a simulation data and an event type.

Communication platform transforming actual utterances to text

A communication platform configured to present the simulation data to a student and receive a response data of the student, each response data comprising an actual utterance of the student, and configured to receive a response and transform the response to text data.

Interaction manager aligning text to utterance slot values to define event measures

An interaction manager module configured to receive text data to determine event data and to align event data of the student to an utterance slot value to define an utterance slot score as an event measure for the student.

Measurement environment executing performance score algorithm from event measures

A measurement environment configured to execute a performance score algorithm to determine a performance score from first and second event measures as a performance measure for the student.

Predefined utterance scoring data with utterance slots and slot values

A predefined utterance scoring data wherein the utterance type defines an utterance slot, the utterance slot corresponding to a plurality of utterance slot values, each utterance slot value corresponding to an expected utterance of the student and corresponding to an utterance slot score.

User interface presenting simulation data and providing response data for scoring

A user interface configured to present the simulation data to a student and receive a response data of the student to the simulation data, where the communication platform transforms the response data to text data and the measurement environment comprises predefined performance scoring data and a performance score algorithm to determine a performance measure based on performance data.

Next simulation selection based on event data, current state, and transition data

An interaction manager module configured to receive text data as event data and define a next simulation data to present to the student based on the event data, the current state of the student and the transition data, where the event type defines a transition data based on an event data and a current state of the student.

Transition table relating event data, current state and next simulation data

A transition data comprising a transition table relating the event data, the current state of the student and the next simulation data.

The independent claims center on a computer-based communications training simulator that (1) stores training content with simulation data and event types, (2) uses a communication platform to transform actual utterances into text, (3) employs an interaction manager to align text to predefined utterance slots and derive event measures, and (4) uses a measurement environment with predefined utterance scoring data and a performance score algorithm to compute performance measures and to select subsequent simulation presentation based on transition data and current state.

Stated Advantages

Enables an individual student to practice communications and coordination in individual or teaming scenarios without requiring live pilots and other participants.

Transforms speech communication to text and aligns text data to performance measurement database values to determine performance measures of speech communication.

Integrates the simulator/trainer with performance measuring software to evaluate communications for completeness, accuracy, order, brevity, and timeliness.

Automates objective performance measurements without the need for live observation and provides instructors with detailed assessments for feedback and after action reviews.

Stores training session data for replay by the student and the instructor, and feedback modules can show progress and trends and allow adjustment of training curriculum.

Intelligent synthetic entities enable spoken language interactions that increase fidelity of training and avoid inconsistency of human role players.

Diagnostic performance assessment provides real-time feedback informing students not only when they performed well or poorly but what specifically led to the assessment, allowing effective independent learning.

Documented Applications

Train an unmanned aircraft systems (UAS) operator to better communicate in their operational environment.

Train workers that work in a distributed work environment and communicate with other workers over a communications network.

Computer-based training for any role relying on proper communications such as remote help desk personnel, call-center personnel, air traffic controllers, emergency responders, financial and legal professionals, or hospital personnel.

Train a student who needs to analyze a situation or receive a communication and respond in a structured manner where content, accuracy, completeness, and timeliness is important, exemplified by a 911 operator.

Train human-machine teaming situations where a human needs to communicate verbally or textually with a robot or other artificial entities.

Create structured reports such as weather reports and communications to people who have limited English vocabularies.

Integration into a NVTT training simulator to progress UAS scout mission scenarios involving assets and virtual team entities with speech recognition, speech-to-text, text-to-speech, and language recognition.

JOIN OUR MAILING LIST

Stay Connected with MTEC

Keep up with active and upcoming solicitations, MTEC news and other valuable information.