Graphical user interfaces including touchpad driving interfaces for telemedicine devices

Inventors

Jordan, Charles S. • Young, Andy • Ng, Mei Sheng • Lurie, Yair • Lai, Fuji • Wright, Timothy C. • Herzog, Cody • Whitney, Blair • Rizzi, Bill • Ballantyne, James • Wang, Yulun • Wong, Cheuk Wah • Kearns, Justin H. • Taka, Orjeta • Karandikar, Ramchandra

Assignees

Teladoc Health Inc

Interested in licensing this patent?

MTEC can help explore whether this patent might be available for licensing for your application.

Publication Number

US-12165776-B2

Patent

Publication Date

2024-12-10

Expiration Date


Abstract

The present disclosure describes various aspects of remote presence interfaces (RPIs) for use on portable electronic devices (PEDs) to interface with remote presence devices. An RPI may allow a user to interact with a telepresence device, view a live video feed, provide navigational instructions, and/or otherwise interact with the telepresence device. The RPI may allow a user to manually, semi-autonomously, or autonomously control the movement of the telepresence device. One or more panels associated with a video feed, patient data, calendars, date, time, telemetry data, PED data, telepresence device data, healthcare facility information, healthcare practitioner information, menu tabs, settings controls, and/or other features may be utilized via the RPI.

Core Innovation

The disclosed invention describes a remote presence interface (RPI) on a portable electronic device (PED) used with telemedicine/telepresence systems. The PED supports secure login and receiving a user selection of a destination, including selecting from remote presence devices and endpoints associated with the telepresence system. The interface presents live video together with patient, telemetry, and calendar panels and provides interactive control for a telepresence robot.

The invention includes automatic selection and navigation logic that selects a remote presence device from a plurality based on reducing travel to the selected destination through one or more areas indicated as undesirable areas. The automatically selecting includes not selecting another remote presence device that must travel through one of the undesirable areas, and the system navigates the selected remote presence device to the selected destination without passing through one of the undesirable areas.

The document also describes graphical user interface features for driving and navigation, including touch, click, vector, joystick, mouse-based driving, and destination selection such as click-to-destination. The interface accounts for video latency via lookup-table compensation and provides interactive overlays such as touchpad and vector overlays and toolbars, status, and help overlays, along with media recording and management and picture-in-picture or fullscreen video and data modes.

The document further describes integration of patient data and monitoring through ADT/HL7 and bedside biometrics, including alerts that can trigger autonomous navigation and invitations. It also supports multi-user and participant sessions and an obstacle-detection nudge mode, together with a context in which undesirable areas are used to avoid environments such as poor wireless connectivity and confined, high-traffic, sensitive, secure, and dangerous areas.

Claims Coverage

The partial content identifies two independent claims, a computer-readable medium claim and a telepresence system claim, with the same core inventive concept expressed in both. Each independent claim centers on three inventive operations: receiving a user-selected destination, automatically selecting an appropriate remote presence device to reduce travel by avoiding undesirable areas, and navigating the selected remote presence device to the selected destination without passing through the undesirable areas.

Receiving a user selection of a destination

The processor performs operations comprising receiving a user selection of a destination.

Automatically selecting a remote presence device based on reducing travel through undesirable areas

The processor automatically selects a remote presence device from a plurality of remote presence devices based at least on reducing travel to the selected destination through one or more areas indicated as undesirable areas, wherein automatically selecting includes not selecting another remote presence device that must travel through one of the undesirable areas.

Navigating without passing through undesirable areas

The processor navigates the selected remote presence device to the selected destination without passing through one of the undesirable areas.

Telepresence system with portable electronic device configured to select and navigate

A telepresence system comprising a plurality of remote telepresence devices and a portable electronic device configured to receive a user selection of a destination, automatically select a remote presence device from a plurality based at least on reducing travel through one or more areas indicated as undesirable areas, and navigate the selected remote presence device to the selected destination without passing through one of the undesirable areas.

Across the identified independent claims, the inventive coverage is directed to destination-driven remote presence, where the system both selects an appropriate remote presence device from a plurality and navigates that device to the destination while avoiding one or more areas indicated as undesirable areas to reduce travel.

Stated Advantages

Reduces travel to the selected destination by selecting a remote presence device that avoids undesirable areas.

Avoids passing through one of the undesirable areas during navigation to the selected destination.

Documented Applications

Telemedicine and telepresence systems using a remote presence interface on a portable electronic device for live video and patient, telemetry, and calendar presentation with interactive control of a telepresence robot.

Healthcare-related telepresence navigation where undesirable areas may include poor wireless connectivity and confined, high-traffic, sensitive, secure, and dangerous areas.

Patient data monitoring and care team workflows using ADT/HL7 integration and bedside biometrics, including alerts that can trigger autonomous navigation and invitations.

Multi-user and participant telepresence sessions with telepresence device control and navigation.

Obstacle-detection nudge mode in the telepresence context.

JOIN OUR MAILING LIST

Stay Connected with MTEC

Keep up with active and upcoming solicitations, MTEC news and other valuable information.