Systems and methods for combining hyperspectral images with color images
Inventors
Freeman, Jenny • Panasyuk, Svetlana • Hopmeier, Michael • Schomacker, Kevin • Brand, Derek
Assignees
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Publication Number
US-10321869-B2
Publication Date
2019-06-18
Expiration Date
Abstract
The invention is directed to methods and systems of hyperspectral and multispectral imaging of medical tissues. In particular, the invention is directed to new devices, tools and processes for the detection and evaluation of diseases and disorders such as, but not limited to diabetes and peripheral vascular disease and cancer, that incorporate hyperspectral or multispectral imaging.
Core Innovation
The described invention provides hyperspectral/multispectral medical imaging using a spectral imager that resolves light obtained from a region of interest of a subject into a plurality of component spectral bands. The spectral imager includes a lens in optical connection with an image sensor, and the resolved bands are used to construct image representations tied to metabolic-state related tissue characteristics. The system is configured for diagnostic use on medical tissues, including tissue associated with diabetic foot ulcers and peripheral vascular or venous disease.
A computer system constructs image outputs from a hyperspectral cube constructed from the component spectral bands. The computer system constructs a color photo image by concatenating three planes from the hyperspectral cube, constructs a pseudo color image based on the component spectral bands, and combines the pseudo color image with the color photo image to form a composite image. The pseudo color image is defined by a color hue plane, a color saturation plane, and a color intensity plane, with hue and saturation representing oxyhemoglobin concentration, deoxyhemoglobin concentration, or mathematical combinations of oxyhemoglobin and deoxyhemoglobin, while intensity represents reflectance in a region about 450 nm to about 580 nm.
The disclosed approach characterizes metabolic state and related tissue behavior using oxyhemoglobin and deoxyhemoglobin derived coefficients, with hue and saturation planes used to represent a first and second characteristic that differ from one another, and with intensity used to represent reflectance in the specified wavelength region. The resulting composite imaging representation is described as supporting separation between healing and non-healing conditions, monitoring changes over time related to microvasculature and angiogenesis, and mapping spatial heterogeneity and risk gradients for ulcer progression and treatment evaluation.
Claims Coverage
The partial content includes one independent claim with inventive features centered on spectral imaging hardware plus a specific pseudo-color construction from hyperspectral cube planes using oxyhemoglobin and deoxyhemoglobin for hue and saturation and reflectance in a defined wavelength region for intensity.
Spectral imager resolving component spectral bands from a region of interest
A spectral imager configured to resolve light obtained from a region of interest of a subject into a plurality of component spectral bands, wherein the spectral imager comprises a lens in optical connection with an image sensor.
Hyperspectral cube plane concatenation into a color photo image
A computer system that constructs a color photo image by concatenating three planes from a hyperspectral cube constructed from the plurality of component spectral bands.
Pseudo color image from oxyhemoglobin and deoxyhemoglobin hue and saturation planes plus reflectance intensity plane
The computer system constructs a pseudo color image in which constructing comprises defining a color hue plane representing a first characteristic selected from oxyhemoglobin concentration, deoxyhemoglobin concentration, or a mathematical combination thereof; defining a color saturation plane representing a second characteristic selected from oxyhemoglobin concentration, deoxyhemoglobin concentration, or a mathematical combination thereof, the second characteristic being different than the first; and defining a color intensity plane representing reflectance in a region about 450 nm to about 580 nm.
Composite image combining pseudo color image with color photo image
The computer system combines the pseudo color image with the color photo image to form a composite image.
Across the independent claim, the inventive core is the combination of a lens-and-image-sensor spectral imager that resolves component spectral bands and a computer system that forms a composite image by concatenating three hyperspectral cube planes into a color photo image and by generating a pseudo color image with separately defined hue, saturation, and intensity planes tied to oxyhemoglobin and deoxyhemoglobin for hue and saturation and reflectance for intensity, followed by combination into a composite image.
Stated Advantages
Described as providing advantages over standard point/non-imaging modalities.
Reports separation of healing versus non-healing ulcers using the described imaging characterization.
Supports monitoring microvasculature and angiogenesis over time.
Supports mapping spatial heterogeneity and risk gradients for ulcer progression and treatment evaluation.
Documented Applications
Diagnosis and monitoring of tissue metabolic state for diabetic foot ulcers and peripheral vascular or venous disease.
Monitoring ulcer healing versus non-healing conditions.
Monitoring microvasculature and angiogenesis over time in relation to wound healing.
Evaluating treatment or therapy including pro-angiogenic agents, anti-angiogenic agents, negative pressure wound therapy, and hyperbaric therapy.
Mapping spatial heterogeneity and risk gradients for ulcer progression and treatment evaluation.
Interested in licensing this patent?