Enhanced diagnostics for a telepresence robot
Inventors
Pinter, Marco • Wright, Timothy C. • Reynolds, H. Neal • Lai, Fuji • Wang, Yulun
Assignees
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Publication Number
US-12142351-B2
Publication Date
2024-11-12
Expiration Date
Abstract
A telepresence device may autonomously check patients. The telepresence device may determine the frequency of checking based on whether the patient has a risk factor. The telepresence device may include an image sensor, a thermal camera, a depth sensor, one or more systems for interacting with patients, or the like. The telepresence device may be configured to evaluate the patient's condition using the one or more sensors. The telepresence device may measure physiological characteristics using Eulerian video magnification, may detect pallor, fluid level, or fluid color, may detect thermal asymmetry, may determine a psychological state from body position or movement, or the like. The telepresence device may determine whether the patient is experiencing a potentially harmful condition, such as sepsis or stroke, and may trigger an alarm if so. To overcome alarm fatigue, the telepresence device may annoy a care provider until the care provider responds to an alarm.
Core Innovation
The invention provides a telepresence system in which a telepresence device coupled to a network captures video in a vicinity of a patient using a camera and provides the video to a control device. The system also includes a monitor, a microphone, and a speaker on the telepresence device, and a similar set of audio-visual components on the control device, so that a session can be established and video captured by either camera can be displayed at the respective monitor during the session.
Within the telepresence system, the telepresence device analyzes the video to determine a color and a fluid level of a fluid bag in the video. The determined color and fluid level are transmitted to a server and stored in an electronic medical record. The server is configured to control a movement of the telepresence device based on the video-derived information and to trigger an alarm when the determined color of the fluid bag deviates from a predetermined norm.
The system further refines video analysis by using Eulerian video magnification to detect a change in color and to detect a movement in the video. From the detected change in color, the system measures a heart rate, and from the detected movement, the system measures a respiration rate. In addition, the system incorporates a thermal camera to measure a patient body temperature.
Claims Coverage
The independent claim specifies a telepresence system with video analysis for fluid bag color and fluid level, server-based session control with electronic medical record storage, movement control, and alarm triggering based on deviation from a predetermined norm. The dependent claims refine the video analysis using Eulerian video magnification and extend downstream measurements to heart rate, respiration rate, and body temperature using a thermal camera, for a total of four inventive measurement directions linked to the core video-derived indicators.
Telepresence video analysis of fluid bag color and fluid level with server storage
A telepresence system in which a telepresence device coupled to a network captures video of a vicinity of a patient and analyzes the video to determine a color and a fluid level of a fluid bag in the video, and wherein the determined color and fluid level are transmitted to a server and stored in an electronic medical record.
Session-based bidirectional video display between telepresence device and control device
A telepresence system in which a control device coupled to the network and a server coupled to the network establish a session between the control device and the telepresence device, such that during the session the control device monitor displays video captured by the camera of the telepresence device and the telepresence device monitor displays video captured by the control device camera.
Movement control and alarm triggering based on fluid bag color deviation
A telepresence system in which the server is configured to control a movement of the telepresence device and trigger an alarm when the determined color of the fluid bag deviates from a predetermined norm.
Eulerian video magnification for detecting a change in color
A telepresence system in which the telepresence device uses Eulerian video magnification to detect a change in color in the video.
Heart rate measurement from the detected color change
A telepresence system in which, based on the detected change in color, the system measures a heart rate of the patient.
Eulerian video magnification for detecting a movement
A telepresence system in which the telepresence device uses Eulerian video magnification to detect a movement in the video.
Respiration rate measurement from the detected movement
A telepresence system in which, based on the detected movement, the system measures a respiration rate of the patient.
Thermal camera for measuring patient body temperature
A telepresence system in which the system measures a body temperature of the patient using a thermal camera coupled to the telepresence device.
The claim set covers a telepresence system that performs video analysis to determine fluid bag color and fluid level, transmits those determinations to a server for electronic medical record storage, and uses server logic to control telepresence device movement and trigger an alarm when fluid bag color deviates from a predetermined norm. Dependent features refine the video analysis using Eulerian video magnification to detect color change and movement, enabling heart rate and respiration rate measurement from those detected indicators, and add thermal-camera-based patient body temperature measurement.
Stated Advantages
Not explicitly described in patent.
Documented Applications
Not explicitly described in patent.
Interested in licensing this patent?