Interactive electronic content delivery in coordination with rapid decoding of brain activity
Inventors
Furman, Daniel • Kwalwasser, Eitan
Assignees
Arctop Ltd • National Science Foundation NSF
Publication Number
US-11662816-B2
Publication Date
2023-05-30
Expiration Date
2038-11-20
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Abstract
A method and system for providing a user with virtual objects within an environment, characterizing interactions with the virtual objects using a brain computer interface, and modulating features of the virtual objects based upon improved classifiers associated with the interactions. The method and system can be used to rapidly customize virtual objects to a specific user in applications related to increasing engagement with traditional and new media content, virtual and augmented reality products, streamlining interactions with input devices in digital and physical environments, providing user authentication tools, providing more secure cybersecurity features, and delivering tailored content to users.
Core Innovation
The invention provides a method and system for delivering interactive digital content to a user within a virtual environment coordinated with rapid decoding of brain activity using a brain-computer interface (BCI). It includes generating classifications of neurological activity of the user as they interact with digital objects, modulating features of the digital objects based on these classified neurological activities, and contemporaneously modulating parameters of brain decoding algorithms. This dual reinforcement loop architecture allows for rapid customization and adaptive modulation of virtual content tailored to the user's brain responses.
The problem addressed is the inability of current systems to rapidly decode neurological activity and coordinate this decoding with the provision of digital content personalized to a user. Existing systems also lack effectiveness in using digital content for authenticating user identities based on neurological responses. The invention aims to improve decoding speed and accuracy, enhance user engagement with interactive content, support secure authentication, and provide tailored experiences in virtual and augmented reality and other digital environments.
Claims Coverage
The patent includes two independent claims describing a method and a system, with inventive features related to simultaneous reinforcement loops for decoding neurological activity and modulating digital objects in a virtual environment.
Mutual reinforcement loops for brain activity classification and content modulation
The method involves providing a digital object to a user within a virtual environment and, responsive to detecting neural signals from a BCI, implementing a first reinforcement loop that classifies neurological activity and reinforces user-object relationships by modulating temporal features of the digital object on different time scales. Contemporaneously, a second reinforcement loop modulates parameters of the decoding algorithm based on user interactions with the digital object.
Adaptive multi-feature digital object modulation
The digital object provided within the virtual environment comprises a body with a set of modulation features including morphological features (shape), motion features, color features, rhythmic features, sonic features, geospatial features, animated features, and transformation features, which are modulated to reinforce user relationship and engagement.
Adaptive thresholding in decoding algorithms with adjustable penalty parameter
Processing the neural signal stream includes implementing an adaptive thresholding operation with an adjustable penalty parameter that regulates false classification frequency, thereby improving decoding accuracy and allowing asymmetric modulation of false positive and false negative rates, affecting learning rate and classification accuracy.
Cognitive state characterization and dynamic content tailoring
The system generates characterizations of cognitive and affective states of the user while interacting with digital objects and modulates digital object features and environmental features accordingly. A user state probing mode allows for provision of stimuli to extract enriched neural signals, enabling authentication of user identity and tailoring of content based on cognitive state.
Generation and refinement of unique neurobiometric user identifiers
Upon convergence of decoding algorithms and reinforced modulation of digital object features, the system generates unique identifiers comprising signatures of cognitive responses for user authentication and continuous identification, which can be refined over time and used to deliver tailored digital content and rewards.
Hardware platform integrating BCI, electronics, and computing architectures for content delivery and decoding
The system comprises a hardware platform coupled to a BCI, with electronics for conditioning neural outputs and a computing subsystem operating in content delivery and detection modes, implementing first and second reinforcement architectures that simultaneously modulate digital object features and decoding algorithm parameters based on neurological activity to rapidly decode brain activity and personalize virtual content.
The claims collectively cover a system and method employing simultaneous reinforcement learning loops for rapid decoding of brain activity and adaptive modulation of digital content features, including adaptive thresholding, cognitive state characterization, user authentication via neurobiometric identifiers, and a hardware platform integrating BCI and computing components, enabling personalized and secure virtual environment interactions.
Stated Advantages
Rapid decoding of user brain activity states enables near real-time dynamic customization of digital objects and virtual environments tailored to user cognitive states.
Efficient processing and delivery of large quantities of neural signal data through streamlined computational pipelines improve system performance beyond previous capabilities.
Generation of novel neurobiometric user identification objects based on reinforced digital objects tuned to individual neurological signatures provides enhanced user differentiation and security.
Documented Applications
Increasing engagement with traditional and new media content.
Providing virtual and augmented reality products with dynamically modulated content.
Streamlining user interactions with input devices in digital and physical environments.
Supplying user authentication tools and enhancing cybersecurity features based on neurological responses.
Delivering tailored content such as entertainment experiences, information, rewards, and lessons within virtual environments.
Use by users remotely moving about in daily life, outside research or clinical environments.
Interested in licensing this patent?