Enhanced video interaction for a user interface of a telepresence network
Inventors
Pinter, Marco • Jordan, Charles S. • Sanchez, Daniel • Hanrahan, Kevin • TEMBY, KELTON • Lambrecht, Christopher
Assignees
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Publication Number
US-10924708-B2
Publication Date
2021-02-16
Expiration Date
Abstract
A telepresence device may relay video, audio, and/or measurement data to a user operating a control device. A user interface may permit the user to quickly view and/or understand temporally and/or spatially disparate information. The telepresence device may pre-gather looped video of spatially disparate areas in an environment. A temporal control mechanism may start video playback at a desired point in a current or historical video segment. Notations may be associated with time spans in a video and recalled by capturing an image similar to a frame in the time span of the video. An area of interest may be selected and video containing the area of interest may be automatically found. Situational data may be recorded and used to recall video segments of interest. The telepresence device may synchronize video playback and movement. A series of videos may be recorded at predetermined time intervals to capture visually trending information.
Core Innovation
The invention relates to a telepresence system in which streaming video received from a telepresence device is displayed to a user and user-provided annotations are captured and retained with patient-related images. The system stores the received annotation and an identification of the user associated with the video and displays the annotation and the user identification when replaying the stored video.
The disclosed approach constrains annotation to a user-specified desired time span, including start and end time behavior. The interface supports temporal playback and navigation for historical segments, including interactive time-span selection with start/end time inputs and replay access to the corresponding annotations.
The disclosed approach also supports time-span-bound events and annotations that include authoring and timestamps, along with interactive timeline overlays for recall and preview. In the context of stored telepresence video, it further supports overlaying annotations such as drawings, highlights, and user notes on the patient images and displaying those overlays during replay with the associated user identification.
Claims Coverage
The independent claim recites 5 main inventive features. Dependent claims refine the independent claim by constraining annotations to a desired time span, supporting interactive navigation tied to the desired time span, enabling drawn overlays over patient images, and storing a user-provided title text associated with an annotation.
Patient video annotation with user identification on replay
Receiving streaming video from the telepresence device, the streaming video including images of a patient; displaying the streaming video to a user; receiving an annotation from the user, the annotation relating to at least one of the images of the patient; storing the received annotation and an identification of the user in association with the video; and displaying the annotation and the identification of the user when replaying the stored video.
Desired time span annotation input
Receiving an indication of a desired time span from the user.
Start-time selection with default time-span end selection
When a desired time span is indicated, receiving a user indicated start time and automatically selecting an end time using a default time span length.
Interactive indication for accessing time-span annotations
Displaying an interactive indication at a location corresponding to a desired time span so a user can access the received annotation via that indication.
Drawn overlay object on patient images for replay
Receiving a drawn object for overlay on one or more patient images and displaying the overlay when replaying a stored video.
User-provided annotation title storage
Storing a title associated with an annotation, the title containing text received from the user.
The core coverage centers on annotating telepresence video segments tied to patient images while storing user identification and displaying that annotation on replay. Refinements constrain annotations to a desired time span with interactive navigation, add drawn overlays over patient images during replay, and add storing a user-provided title text for an annotation.
Stated Advantages
Not explicitly described in patent.
Documented Applications
Not explicitly described in patent.
Interested in licensing this patent?