Active illumination-based multispectral contamination sanitation inspection system
Inventors
Kim, Moon S • Qin, Jianwei • Chan, Diane E • MEINHARDT, LYNDEL • BAEK, INSUCK • Barton, Kenneth • Vasefi, Fartash
Assignees
Safetyspect Inc • US Department of Agriculture USDA
Publication Number
US-12276612-B2
Publication Date
2025-04-15
Expiration Date
2041-11-17
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Abstract
The contamination sanitation inspection system (CSIS) allows a user to capture an image of a large scene (such as a food processing line, a food service facility, a food products storage area, or a plant production area/facility) and identify contamination within the scene and preferably represent the contamination on a spatially accurate map (or floorplan) so that contamination within the inspection map area is clearly identified and recorded for subsequent treatment. In an alternative embodiment, the CSIS also includes a decontamination system to sanitize any identified contamination.
Core Innovation
The invention disclosed is a handheld contamination sanitation inspection system (CSIS) that allows a user to capture an image of a large scene, such as a food processing line, food service facility, or plant production area, and identify contamination within the scene. The CSIS represents the contamination on a spatially accurate map or floorplan so that contamination is clearly identified and recorded for subsequent treatment. This system includes at least one active illumination light and at least one multispectral camera, preferably a chip-based multispectral camera, controlled by a processor that directs image acquisition and processing in varying ambient light conditions.
The background describes a significant problem with outbreaks of food-borne illnesses caused by bacterial contamination in food products and handling facilities. Existing inspection technologies rely on physical filters and standard RGB sensors that are unable to select and use specific wavebands for multispectral imaging. There is a need for an effective multispectral imaging system that can detect contamination efficiently and accurately even in varying lighting environments. The invention solves this by providing a handheld, digital chip-based multispectral imaging system with active illumination, enabling automatic fluorescence-based detection and mapping of contamination.
The system operates by acquiring multispectral images both under ambient light and with pulsed active illumination. The processor subtracts the ambient multispectral image from the illuminated multispectral image to produce a multispectral fluorescence image highlighting contamination. The system includes orientation and position sensing hardware to map contamination precisely on user interfaces or floorplans to facilitate remediation. The CSIS can be used regardless of ambient lighting and can be implemented as a standalone device or as a supplemental module added to mobile devices.
Claims Coverage
The patent includes multiple independent claims focusing on the handheld contamination sanitation inspection system and its method of acquiring multispectral images with synchronized pulsed illumination.
Handheld contamination sanitation inspection system with synchronized pulsed illumination and multispectral imaging
A system comprising at least one active illumination light, at least one chip-based multispectral camera, and a processor controlling both. The processor directs the multispectral camera synchronized with the pulsed illumination light to acquire an ambient light image and an illuminated image, then subtracts the ambient image from the illuminated image to produce a multispectral fluorescence image of the inspection area under various ambient lighting conditions.
Chip-based multispectral camera with matrix of narrow bandpass filters
The multispectral camera includes an image sensor covered by a matrix of narrow bandpass filters configured to pass two or three targeted light wavebands, each about 10-30 nm wide, while filtering out others, enabling precise multispectral image acquisition.
Position and orientation sensing integration for mapping contamination
The system includes position/orientation sensing hardware (e.g., GPS, accelerometer, rangefinder, LiDAR) to map detected contamination onto spatially accurate maps or floorplans of the inspection area for precise localization and easier remediation.
Method of multispectral image acquisition with pulsed illumination
A method where the processor controls pulsing an active illumination LED light ON and OFF while acquiring corresponding multispectral images at two or three targeted wavebands. The processor automatically processes images by subtracting the ambient light image from the illuminated image to produce a multispectral fluorescence image of the inspection area.
The independent claims cover the handheld inspection system's architecture, chip-based multispectral imaging with narrow bandpass filters, position sensing capabilities for contamination mapping, and the method of synchronized pulsed illumination image acquisition and processing to generate fluorescence images highlighting contamination.
Stated Advantages
Enables rapid and effective contamination detection and sanitation inspection under various ambient light conditions.
Allows non-expert users to perform inspections with automated image acquisition, processing, and contamination highlighting.
Provides spatially accurate mapping of contamination on floorplans to improve remediation efficiency.
Facilitates real-time inspection and documentation, including wireless communication for remote oversight and response.
Compact, handheld design improves maneuverability and usability compared to existing bulky systems.
Adaptable for integration into mobile devices, enhancing accessibility and flexibility of inspection technology.
Documented Applications
Inspection of food processing lines, food service facilities, and food product storage areas for contamination detection.
Sanitation inspection in kitchens, dining areas, and other food-related environments.
Plant production areas such as farmer’s fields, greenhouses, and hydroponic facilities to detect plant disease agents and symptoms.
Mobile or portable device augmentation with supplemental CSIS modules for enhanced contamination inspection capabilities.
Interested in licensing this patent?