System, information storage medium, and information processing method
Inventors
Fujii, Masahiro • Arai, Takeshi
Assignees
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Publication Number
US-12593984-B2
Publication Date
2026-04-07
Expiration Date
Abstract
The system includes a memory that stores a trained model, and a processor. The processor acquires a pre-treatment image in which at least one energy device and at least one biological tissue are imaged, and a state before application of energy is imaged. The processor estimates an estimated heat diffusion region from the pre-treatment image and information regarding an energy supply amount by processing based on a trained model stored in the memory. The processor superimposes the estimated heat diffusion region on a captured image of the camera and displays the captured image with the superimposed estimated heat diffusion region.
Core Innovation
The invention relates to a surgical imaging system that uses a trained model to estimate a heat diffusion region, also described as a range of reach of heat from at least one energy device. A pre-treatment image is acquired in which the at least one energy device and at least one biological tissue are imaged in a state before application of energy, with the pre-treatment image captured by a camera that captures an image of a surgical field. Information regarding an energy supply amount to the at least one energy device is also acquired and is used together with the pre-treatment image to estimate the heat diffusion region after application of energy based on the energy supply amount.
The system extracts tissue information regarding the biological tissue imaged in the pre-treatment image and extracts device information regarding the at least one energy device imaged in the pre-treatment image. Based on the tissue information and the device information, the system estimates an estimated heat diffusion region in a treatment target tissue to be treated by the at least one energy device. The system further estimates regions of the treatment target tissue and the at least one energy device in the pre-treatment image, and estimates at least one of a tension applied to a biological tissue and a gripping amount of the at least one energy device as an estimation result.
The estimated heat diffusion region is then estimated based on the estimation result, the tissue information, and the information regarding the energy supply amount. The invention includes superimposing the estimated heat diffusion region on a captured image of the camera and displaying the captured image with the superimposed estimated heat diffusion region on a display, including embodiments with plural stages over time/heat/tension/gripping, and logic using certainty factors and predetermined thresholds to show best mode/worst mode outcomes when estimation is uncertain.
Claims Coverage
The provided independent claims cover a system, a computer-readable non-transitory information storage medium, and an information processing method for estimating and displaying a heat diffusion region. Across the independent claims, the core inventive features are the trained model estimation of the heat diffusion region from a pre-treatment image and an energy supply amount, extraction of tissue and device information, intermediate estimation of treatment-relevant tissue/device parameters, and superimposition display on a camera image.
Trained-model heat diffusion region estimation from pre-treatment image and energy supply amount
A memory configured to store a trained model trained to output a heat diffusion region from a training device tissue image or a training tissue image, where the heat diffusion region is an estimated range of reach of heat from the at least one energy device; and a processor configured to acquire a pre-treatment image of the at least one energy device and the at least one biological tissue in a state before application of energy, acquire information regarding an energy supply amount to the at least one energy device, and estimate the estimated heat diffusion region in the pre-treatment image based on the pre-treatment image, the information regarding the energy supply amount, and the trained model, where the estimated heat diffusion region is an estimated range of reach of energy from the at least one energy device after application of the energy based on the energy supply amount.
Superimposing and displaying the estimated heat diffusion region on a captured camera image
The processor is further configured to perform a process of superimposing the estimated heat diffusion region on a captured image of the camera and displaying the captured image with the superimposed estimated heat diffusion region on a display.
Tissue and device information extraction to estimate the heat diffusion region in a treatment target tissue
The processor extracts, from the pre-treatment image, tissue information regarding a biological tissue that is imaged in the pre-treatment image, and extracts, from the pre-treatment image, device information regarding the at least one energy device that is imaged in the pre-treatment image; the processor estimates, based on the device information and the tissue information, the estimated heat diffusion region in a treatment target tissue to be treated by the at least one energy device.
Estimating tension and/or gripping amount and using it to refine heat diffusion region estimation
The processor estimates regions of the treatment target tissue and the at least one energy device in the pre-treatment image based on the tissue information and the device information, estimates at least one of a tension applied to a biological tissue imaged in the pre-treatment image and a gripping amount of the at least one energy device as an estimation result, and estimates the estimated heat diffusion region based on the estimation result, the tissue information, and the information regarding the energy supply amount.
Across the independent claims, the coverage centers on using a trained model to estimate a heat diffusion region (range of reach of heat) from a pre-treatment camera image combined with energy supply amount information, with additional extraction of tissue information and device information, intermediate estimation of at least one of tension or gripping amount, and a superimposition display of the estimated region on the captured camera image.
Stated Advantages
Enabling pre-emptive adjustment of energy output to avoid thermal damage and improve safety/efficiency.
Documented Applications
Displaying an estimated heat diffusion region superimposed on a live camera image in a surgical field for energy device treatment planning and visualization of heat reach (thermal invasion).
Performing staged predictions over time/heat/tension/gripping and presenting best mode/worst mode outcomes when estimation is uncertain using confidence/threshold logic.
Interested in licensing this patent?