Data processing platform for analyzing stereo-spatio-temporal crop condition measurements to support plant growth and health optimization
Inventors
Humpston, Stephen P. • Stewart, Gregory E. • Schneider, Gavin • Fuxman, Adrian M. • Wspanialy, Patrick O. • Miresmailli, Saber
Assignees
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Publication Number
US-12067711-B2
Publication Date
2024-08-20
Expiration Date
Abstract
An apparatus includes at least one processor configured to obtain stereo-spatio-temporal data measurements of plants in a growing area. The stereo-spatio-temporal data measurements include (i) first spatio-temporal data measurements of the plants in the growing area and (ii) second spatio-temporal data measurements of the plants in the growing area. The at least one processor is also configured to analyze the stereo-spatio-temporal data measurements to identify one or more actual or potential problems associated with one or more of the plants. The at least one processor is further configured to generate a graphical user interface identifying at least one of the one or more actual or potential problems with the one or more plants. The first and second spatio-temporal data measurements of each stereo-spatio-temporal data measurement are associated with at least one common plant characteristic and different three-dimensional positions within the growing area taken at one or more known times.
Core Innovation
The invention provides an apparatus that obtains an image capturing at least part of a growing area and obtains stereo-spatio-temporal data measurements of plants in the growing area. The stereo-spatio-temporal data measurements comprise first spatio-temporal data measurements and second spatio-temporal data measurements associated with at least one common plant characteristic and different three-dimensional positions within the growing area taken at one or more known times.
At least some of the first and second spatio-temporal data measurements comprise data measurements simultaneously captured at different heights by at least one first sensor fixedly mounted on a base of a mobile platform and at least one second sensor mounted on a platform of the mobile platform that is movable relative to the base. The apparatus analyzes the stereo-spatio-temporal data measurements to identify one or more actual or potential pests or diseases associated with one or more of the plants, based on comparing the measurements that share common plant characteristics while differing in three-dimensional positions, and in some implementations based on a flux or a difference in a specified plant-related characteristic along a plurality of heights of one or more of the plants.
After analyzing, the apparatus generates a graphical user interface identifying at least one of the one or more actual or potential pests or diseases with the one or more plants. The graphical user interface comprises the image and at least one indicator identifying the actual or potential pests or diseases, each indicator placed in the image in association with the associated plant, and includes a summary section displayed adjacent to the image providing details related to the indicator.
In further implementations, the graphical user interface includes a two-dimensional or three-dimensional representation of at least part of the growing area and one or more graphs containing at least some of the stereo-spatio-temporal data measurements over time with a second indicator placed in an associated graph. The document also states identifying one or more corrective actions that at least partially resolve the pests or diseases, and associating corrective actions and plant portions with the graphical user interface.
Claims Coverage
The document contains multiple independent claims covering plant monitoring that obtains stereo-spatio-temporal measurements from different 3D positions and different heights, analyzes those measurements to identify actual or potential pests or diseases, and generates a graphical user interface presenting the results with indicators and optional spatial and temporal GUI elements. The independent claims include nine inventive features.
Stereo-spatio-temporal measurements associated with common plant characteristic across different 3D positions at known times
The first and second spatio-temporal data measurements of each stereo-spatio-temporal data measurement are associated with at least one common plant characteristic and different three-dimensional positions within the growing area taken at one or more known times.
Simultaneous multi-height capture with fixed sensor on mobile platform base and movable sensor on movable platform
At least some of the first and second spatio-temporal data measurements comprise data measurements simultaneously captured at different heights by a first sensor fixedly mounted on a base of a mobile platform and a second sensor mounted on a platform of the mobile platform that is movable relative to the base, used to identify actual or potential pests or diseases.
GUI overlay with pest/disease indicators in the image and adjacent summary section
The graphical user interface comprises the image, at least one indicator identifying the pests or diseases placed in the image in association with the associated plant, and a summary section displayed adjacent to the image and providing details related to the indicator.
GUI with spatial representation using two-dimensional or three-dimensional representation and separate indicators
The graphical user interface comprises the image, a two-dimensional or three-dimensional representation of at least part of the growing area, and indicators placed in the representation in association with a location of the associated plant.
GUI with time-series graphs and indicators placed in associated graphs
The graphical user interface comprises the image, one or more graphs containing at least some of the stereo-spatio-temporal data measurements over time, and indicators placed in an associated graph in association with a data measurement of the associated plant.
Corrective action identification and GUI indicators for corrective actions
The claims identify one or more corrective actions that at least partially resolve the pests or diseases, and the graphical user interface includes indicators for the corrective actions in association with the associated plant to which the corrective action is to be applied.
Identification based on flux or difference across heights of a specified plant-related characteristic
The pests or diseases are identified based on a flux or a difference in a specified plant-related characteristic along a plurality of heights of one or more of the plants.
Plant portion localization and corrective action per pest/disease
For each pest or disease, a portion of the associated plant that is or may be suffering from the pest or disease is identified, and a corrective action to be applied to that portion is identified.
Graphical user interface with image indicators and adjacent summary section for the first indicators
The graphical user interface comprises the image, first indicators identifying the pests or diseases placed in the image in association with the associated plant, and a summary section displayed adjacent to the image and providing details related to the first indicators.
Across the independent claims, the core claim coverage is for capturing images and stereo-spatio-temporal measurements of plants from different 3D positions and simultaneously different heights using a fixed sensor on a mobile platform base and a movable sensor on the mobile platform, analyzing the measurements to identify actual or potential pests or diseases, and generating a graphical user interface that associates pest or disease indicators with the associated plants, optionally adding a summary section, spatial representation, time-series graphs, and corrective action indicators.
Stated Advantages
Documented Applications
No documented applications found
Interested in licensing this patent?