Single image sensor for capturing mixed structured-light images and regular images
Inventors
Wang, Kang-Huai • Xu, Yi • Wilson, Gordon C. • Wu, Chenyu
Assignees
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Publication Number
US-11102428-B2
Publication Date
2021-08-24
Expiration Date
Abstract
An integrated image sensor for capturing a mixed structured-light image and regular image using an integrated image sensor are disclosed. The integrated image sensor comprises a pixel array, one or more output circuits, one or more analog-to-digital converters, and one or more timing and control circuits. The timing and control circuits are arranged to perform a set of actions including capturing a regular image and a structured-light image. According to the present invention, the structured-light image captured before or after the regular image is used to derive depth or shape information for the regular image. An endoscope based on the above integrated image sensor is also disclosed. The endoscope may comprises a capsule housing adapted to be swallowed, where the components of integrated image sensor, a structured light source and anon-structured light source are enclosed and sealed in the capsule housing.
Core Innovation
An integrated image sensor captures a structured-light image formed on a common image plane during a first frame period and captures one or more regular images on the same common image plane during second and third frame periods. The sensor resets rows of pixels using reset signals, exposes the rows to first illumination from a structured light source for the structured-light frame, and exposes the rows to second illumination from a non-structured light source for the regular frames. The sensor converts pixel analog signals into digital outputs using one or more analog-to-digital converters having a first dynamic range and a second dynamic range.
The timing and control circuits arrange that the structured-light image is captured between the first regular image and the second regular image. The sensor combines the second digital outputs and the third digital outputs to form a combined regular image, while the structured-light capture is used to derive depth or shape information for the combined regular image. The integrated image sensor includes one or more output circuits coupled to the pixel array to access pixel signals, and the same common image plane is used for both structured-light and regular images.
The sensor further supports implementation where the one or more analog-to-digital converters realize the first dynamic range and the second dynamic range. Implementation options include configurable analog-to-digital converters providing both dynamic ranges, or two analog-to-digital converters having two different resolutions to provide the first and second dynamic ranges. The structured-light image may be captured at lower spatial resolution than the regular images, and the endoscope/capsule implementation encloses imaging components in a sealed capsule housing for in vivo viewing.
Claims Coverage
The document provides three independent claims: one integrated image sensor claim, one camera system claim, and one endoscope claim. Each independent claim recites the same core capture sequence using a pixel array with a structured-light frame captured between two regular frames, combined with the use of analog-to-digital converters providing a first and second dynamic range, to derive depth or shape information for a combined regular image.
Integrated image sensor with structured-light capture between regular images for depth or shape information
An integrated image sensor with a pixel array and output circuits, and one or more analog-to-digital converters having a first dynamic range and a second dynamic range, and timing and control circuits arranged to capture a structured-light image on a common image plane during a first frame period, capture a first regular image during a second frame period and a second regular image during a third frame period on the same common image plane, combine the second and third digital outputs to form a combined regular image, and capture the structured-light image between the first regular image and the second regular image to derive depth or shape information for the combined regular image.
Camera system with structured-light frame between two regular images for depth or shape information
A camera system with a structured light source, a non-structured light source, and an integrated image sensor having a pixel array, output circuits, analog-to-digital converters with a first dynamic range and a second dynamic range, and timing and control circuits arranged to capture a structured-light image during a first frame period, capture first and second regular images during second and third frame periods on a common image plane, combine the regular-image digital outputs to form a combined regular image, and capture the structured-light image between the first regular image and the second regular image to derive depth or shape information for the combined regular image.
Endoscope for in vivo GI viewing with structured-light capture between two regular images for depth or shape information
An endoscope for in vivo viewing of the human gastrointestinal (GI) tract with a structured light source, a non-structured light source, and an integrated image sensor having a pixel array, output circuits, analog-to-digital converters with a first dynamic range and a second dynamic range, and timing and control circuits arranged to capture a structured-light image during a first frame period, capture a first regular image during a second frame period and a second regular image during a third frame period on a common image plane, combine the regular-image digital outputs to form a combined regular image, and capture the structured-light image between the first regular image and the second regular image to derive depth or shape information for the combined regular image.
Across the three independent claims, the inventive coverage centers on capturing a structured-light image on a common image plane between two regular images, combining the regular-image digital outputs to form a combined regular image, and deriving depth or shape information for that combined regular image using the structured-light capture, with analog-to-digital converters configured to provide a first and a second dynamic range.
Stated Advantages
Derive depth or shape information for the combined regular image.
Documented Applications
In vivo viewing of the human gastrointestinal (GI) tract using an endoscope.
Interested in licensing this patent?