Systems and methods for computer monitoring of remote photoplethysmography based on chromaticity in a converted color space
Inventors
Assignees
Arizona State University ASU • Arizona State University Downtown Phoenix campus
Publication Number
US-11229372-B2
Publication Date
2022-01-25
Expiration Date
2037-09-21
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Abstract
Provided herein are systems and methods for computer monitoring of remote photoplethysmography (rPPG) from camera images based on chromaticity in a converted color space, which reduces motion-induced artifacts in camera images for improved rPPG computer monitoring of physiological parameters. In particular, a rPPG system for monitoring at least one physiological parameter from image data is disclosed herein. A processor subsystem electronically receives a first image data set representative of a series of consecutive images of at least a portion of a living body. The processor subsystem converts the first image data set from a first color space to a second color space to generate a second image data set including first channel data comprising a luminance component and second channel data comprising a chromatic component. The processor subsystem processes the second channel data to monitor the at least one physiological parameter of the living body.
Core Innovation
The invention provides systems and methods for remote photoplethysmography (rPPG) computer monitoring based on chromaticity in a converted color space. Specifically, it discloses a system and method where a processor subsystem receives a first image data set from a camera representing consecutive images of part of a living body, converts this image data from an initial color space (such as RGB) to a second color space (such as CIELab), and generates a second image data set including channel data consisting of luminance and chromatic components. The system then processes the chromatic channel data to monitor at least one physiological parameter of the living body.
The system addresses the problem that traditional rPPG methods, which work well for still subjects in laboratory settings, are subject to significant motion-induced artifacts when used in real-world environments where the subject may move. Most existing methods using RGB color space are particularly vulnerable to these artifacts, resulting in unreliable physiologic monitoring. The need exists for rPPG monitoring devices that minimize the influence of motion-induced artifacts and provide accurate readings in practical, non-laboratory conditions.
To solve this, the disclosed approach uses color space conversion, particularly to perceptually uniform spaces such as CIELab, to separate illumination changes (which are susceptible to motion artifacts) from chromatic changes (which are more closely associated with physiological signals). The system includes automatic selection and tracking of an optimal region of interest (ROI) on the living body, as well as pruning of image frames when the ROI is not captured. This process allows extraction of physiological signals, such as heart rate or breathing patterns, with improved accuracy under normal, everyday conditions and across diverse skin tones.
Claims Coverage
The patent contains multiple independent claims that define several main inventive features, particularly focused on systems, methods, and computer-readable media for improved rPPG monitoring using chromaticity in a specific color space.
Computer-based rPPG monitoring using a* channel data in perceptually uniform color space
A remote photoplethysmography (rPPG) system includes a processor subsystem that: - Electronically receives a first image data set representing consecutive images of at least part of a living body. - Converts the first image data set from a first color space (such as RGB) to a second, perceptually uniform color space (such as CIELab), generating a second image data set with a* channel data, where the a* channel represents chromaticity between green and red. - Processes the a* channel data to monitor at least one physiological parameter. - Automatically determines and tracks a region of interest (ROI) through the image sequence. - Initializes the ROI based on a first image and reinitializes it after a predetermined number of images.
Method for rPPG monitoring utilizing a* channel chromatic data and automatic ROI management
A method implemented by a computer system which: - Receives a first image data set from an optical imaging element as consecutive images of a living body. - Converts the image data from a first color space to a perceptually uniform color space, generating a* channel data describing chromaticity between green and red. - Processes the a* channel data to monitor physiological parameters. - Automatically determines and tracks a region of interest (ROI), and removes image frames if identified feature points in the ROI are below a predetermined threshold.
Computer readable medium with program instructions for a* channel-based rPPG monitoring
A non-transitory computer readable medium comprising program instructions for a processor to: - Receive a first image data set as consecutive images of a living body. - Convert the image data from a first color space to a perceptually uniform color space to generate a* channel data reflecting chromaticity between green and red. - Process the a* channel data to monitor at least one physiological parameter. - Automatically determine and track the ROI; initialize ROI based on a first image and reinitialize after a predetermined number of images.
The inventive features focus on using the a* chromatic channel within a perceptually uniform color space (such as CIELab) for rPPG monitoring, coupled with automatic selection and management of a region of interest, to achieve improved physiological parameter extraction while reducing motion-induced artifacts.
Stated Advantages
Permits reduction of motion-induced artifacts in camera images, improving rPPG computer monitoring of physiological parameters.
Allows more accurate and robust extraction of physiological signals, such as heart rate and breathing pattern, under realistic free-living conditions.
Supports monitoring across varying and diverse skin tones.
Provides improved signal-to-noise ratio and decreased errors in physiological parameter detection compared to conventional RGB space methods.
Documented Applications
Computer monitoring of physiological parameters such as breathing pattern, respiration rate, and heart rate from image data using non-contact camera systems.
Use in home care units, desktops, laptops, tablets, smartphones, or other devices with cameras for non-invasive subject monitoring.
Application in realistic environments, including at home or in the workplace, where subjects may move naturally.
Interested in licensing this patent?