Single image sensor for capturing mixed structured-light images and regular images
Inventors
Wang, Kang-Huai • Xu, Yi • Wilson, Gordon C. • Wu, Chenyu
Assignees
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Publication Number
US-10785428-B2
Publication Date
2020-09-22
Expiration Date
Abstract
A method and apparatus for imaging a body lumen are disclosed. According to the method, an imaging apparatus is induced into the body lumen. Structured light from the imaging apparatus is projected into the body lumen. The structured light reflected from anatomical features in the body lumen is detected by the imaging apparatus. A first structured light image is generated from the detected structured light by the imaging apparatus. Non-structured light is emitted from the imaging apparatus into the body lumen. The non-structured light reflected from the anatomical features in the body lumen is detected by the imaging apparatus. A non-structured light image is generated from the detected non-structured light by the imaging apparatus. The frame period of the first structured light image is shorter than the frame period of the non-structured light image. In one embodiment, the imaging apparatus corresponds to a capsule endoscope.
Core Innovation
The invention relates to imaging a body lumen by introducing an imaging apparatus into the body lumen and capturing a first structured image and a non-structured image. Structured light is projected into the body lumen, reflected from anatomical features is detected, and a first structured light image is generated from the detected structured light. Non-structured light is emitted into the body lumen, reflected non-structured light is detected, and a non-structured light image is generated from the detected non-structured light.
In a related form, imaging is performed by capturing a first non-structured light image, then capturing a structured light image, and then capturing a second non-structured light image, with the structured light image performed between the first and second non-structured images in series. The first non-structured light image and the second non-structured light image are combined to form a combined non-structured light image.
The structured light capture is configured to use shorter frame period by employing reduced required dynamic range and/or reduced spatial resolution, with associated sensor/ADC dynamic-range settings and optimized timing. The structured light is arranged temporally close to corresponding regular images to improve depth and shape accuracy under motion and in power-limited environments.
Claims Coverage
The document identifies four independent claims, each directed to imaging a body lumen using structured light and non-structured light with serial capture on a same image sensor. Across the independent claims, the inventive features include projecting, detecting, and generating structured and non-structured images in series, using a same image sensor for both captures, capturing multiple non-structured images and combining them, and apparatus implementations with a housing, at least one camera, a structured light source, a non-structured light source, and a control circuit.
Serial structured and non-structured imaging on the same image sensor
Capturing a first structured image by projecting structured light into the body lumen, detecting structured light reflected from anatomical features, and generating a first structured light image; capturing a non-structured image by emitting non-structured light into the body lumen, detecting non-structured light reflected from anatomical features, and generating a non-structured light image; wherein the capturing of the first structured image and the capturing of the non-structured image are performed in series; and wherein a same image sensor of the imaging apparatus is used to capture the first structured image as well as the non-structured image.
Combining first and second non-structured images with structured-light capture in series
Capturing a first non-structured light image; capturing a structured light image; capturing a second non-structured light image; combining the first non-structured light image and the second non-structured light image to form a combined non-structured light image; wherein the capturing of the structured light image is performed between the capturing of the first non-structured image and the capturing of the second non-structured image in series; and wherein a same image sensor of the imaging apparatus is used to capture the first structured image, the first non-structured image as well as the second non-structured image.
Apparatus with structured and non-structured light sources controlled to capture in series on the same image sensor
An apparatus for imaging a body lumen comprising a housing, at least one camera, a structured light source, and a non-structured light source; and a control circuit coupled to the at least one camera and the structured and non-structured light sources, arranged to capture a first structured image by projecting structured light into the body lumen, detecting structured light reflected from anatomical features, and generating the first structured light image; capture a non-structured image by emitting non-structured light into the body lumen, detecting non-structured light reflected from anatomical features, and generating the non-structured light image; wherein the capturing of the first structured image and the capturing of the non-structured image are performed in series; and wherein a same image sensor of the imaging apparatus is used to capture the first structured image as well as the non-structured image.
Apparatus capturing first and second non-structured images with structured-light capture in series and combining non-structured images
An apparatus for imaging a body lumen comprising a housing, at least one camera, a structured light source, and a non-structured light source; and a control circuit coupled to the at least one camera and the structured and non-structured light sources, arranged to capture a first non-structured image by emitting non-structured light into the body lumen, detecting non-structured light reflected from anatomical features, and generating the first non-structured light image; capture a structured image by projecting structured light into the body lumen, detecting structured light reflected from anatomical features, and generating the structured light image; capture a second non-structured image by emitting the non-structured light into the body lumen, detecting non-structured light reflected from anatomical features, and generating the second non-structured light image; combine the first non-structured light image and the second non-structured light image to form a combined non-structured light image; wherein the capturing of the structured light image is performed between the capturing of the first non-structured image and the capturing of the second non-structured image in series; and wherein a same image sensor of the imaging apparatus is used to capture the first structured image, the first non-structured image as well as the second non-structured image.
Collectively, the independent claims cover method and apparatus implementations for imaging a body lumen using structured light and non-structured light with serial capture using a same image sensor, and include an option to capture two non-structured images around a structured-light image and combine them to form a combined non-structured light image.
Stated Advantages
improve depth and shape accuracy under motion and in power-limited environments
Documented Applications
Imaging of a body lumen, notably including the GI tract, using an imaging apparatus that can be implemented as a capsule endoscope.
Interested in licensing this patent?