Brain computer interface (BCI) system that can be implemented on multiple devices
Inventors
Hochberg, Leigh • Simeral, John D. • Singer-Clark, Tyler • Gross, Ronnie • Hosman, Thomas • Kapitonava, Anastasia • Crawford, Rekha
Assignees
General Hospital Corp • Brown University • US Department of Veterans Affairs
Publication Number
US-11972050-B2
Publication Date
2024-04-30
Expiration Date
2042-11-01
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Abstract
Instances of a single brain computer interface (BCI) system can be implemented on multiple devices. An active instance can control the associated device. The instances can each communicate with a neural decoding system that can receive neural signals from a user, process the neural signals, and output a command based on the processed neural signals. A device running the active instance of can be in communication with the neural decoding system to receive a command. The device can include a display, a non-transitory memory storing instructions, and a processor to execute the instructions to: run an instance of a control program; and execute the task based on the command.
Core Innovation
The invention provides a single brain computer interface (BCI) system that can be implemented as multiple instances on multiple devices, allowing one user to control multiple devices with neural signals. Each instance of the control program can communicate with a neural decoding system that receives and processes neural signals from the user to output commands used by the active instance to execute tasks on the corresponding device. Only one instance on one device is active at a time to receive commands and perform tasks, while other instances are inactive.
The problem addressed is that previous BCI systems allow a user to control only a single device and require multiple separate BCI systems and technician support to switch control between devices. Prior systems have limited commands and functions that are device-specific and do not permit users to independently select or switch among different devices for control. This limitation restricts user independence and flexibility when interacting with multiple electronic or assistive devices.
The present disclosure also includes methods for starting and switching active instances of the control program on different devices, obtaining confirmation for device operations to prevent unintended actions, and calibrating the BCI system for improved control. The BCI system allows continuous calibration across devices and user-initiated calibration without relying on external assistance, thus enhancing user independence.
Claims Coverage
The claims cover one method and one system with multiple inventive features related to implementing and switching control of a BCI system among multiple devices, receiving neural commands, and ensuring active instance control.
Controlling multiple devices via active and inactive instances of a control program
Starting an instance of a control program on a device communicating with a neural decoding system; receiving neural signal-based commands; determining device active status; executing tasks only on the active device; starting instances on multiple devices; switching control between devices upon request from the user via the neural decoding system; and sending instructions to switch control accordingly.
Mapping neural signals to commands related to imagined words or gestures
Commands received by the control program can be related to neural signals representing imagined word commands and/or imagined gestures or movements by the user.
Caregiver-controlled device override functionality
An alternate device can be controllable by a caregiver to take control of a device when the user is unable to control it via neural signals.
Recognition and display of active and inactive instances of the control program
Instances running on devices recognize other instances on other devices in communication with the neural decoding system; the control program displays a graphic indicating which instance is active and controlling at a given time.
Graphical user interface overlay and cursor control
The control program displays a GUI and/or cursor overlay on at least a portion of the device's display, facilitating user interaction based on neural commands.
Confirmation process before changing device operations
Before executing tasks that change device or GUI operations, a confirmation graphic is displayed and execution proceeds only if confirmation is received; otherwise, the task is cancelled.
Calibration game for neural command mapping
A calibration game is executed to calibrate the mapping between neural signals and device commands based on user or system request to improve control accuracy.
Broadcasting detection of new control program instances
When a new instance of the control program is detected, a message is sent and detected by all instances communicating with the neural decoding system to inform connected devices.
Quality alerts for neural signal and decoding performance
The system alerts the user if neural signal quality input or decoding quality falls below predetermined limits, using visual, aural, or tactile feedback.
Pausing and restarting active control via specific neural patterns
The control program can be paused based on a specific neural signal pattern and restarted upon receiving another specific pattern, allowing the user to temporarily disable and re-enable BCI control.
The claims collectively cover a multi-device BCI system with active and inactive control program instances, command processing based on neural signals including imagined commands, caregiver override, GUI and cursor overlays, safety confirmation steps, calibration games, messaging about control instances, quality alerts, and pause-resume control triggered by neural patterns.
Stated Advantages
Allows a user to easily switch control among multiple devices without technician support.
Increases user independence and control over multiple electronic, assistive, or robotic devices with a single BCI system.
Supports continuous calibration and user-initiated calibration improving control accuracy without external assistance.
Provides safety confirmation prompts to reduce unintended device operations.
Includes alerts for neural signal and decoding quality to maintain better system performance.
Enables caregiver takeover of control when user is unable to operate devices.
Documented Applications
Providing control of desktop computers, tablets, smart telephones, and robotic arms by a user via neural signals.
Allowing users with paralysis or disabilities to control multiple computing and assistive devices through a single BCI system.
Using the BCI system for executing tasks including browsing the internet, sending emails, reading e-books, watching movies, interacting with GUIs, and controlling robotic devices.
Employing the system in rehabilitative and assistive devices, and smart televisions as part of the controlled devices.
Interested in licensing this patent?