Electronic device with intuitive control interface
Inventors
Ely, Colin M. • DE JONG, Erik G. • Lynch, Stephen Brian • Rothkopf, Fletcher R.
Assignees
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Publication Number
US-12476881-B2
Publication Date
2025-11-18
Expiration Date
Abstract
An electronic device may include a display system and control circuitry. The user's environment may be presented on the display system. The environment on the display system may be a captured image of the environment, may be the actual real world viewed through an optical combiner, or may be a completely virtual image representing the environment. The control circuitry may gather information about external electronic devices in the user's environment, including determining a type and location of each external electronic device and a status of wireless communications links between external electronic devices. The display system may overlay computer-generated display elements onto the user's environment to indicate the status of wireless communications links between the external electronic devices. In response to touch or gesture input, the control circuitry may send control signals to the external electronic devices to establish or break wireless communications links between external electronic devices.
Core Innovation
An electronic device, optionally a head-mounted device, presents a user’s surrounding environment. The environment is presented as captured camera imagery, a see-through optical combiner view, or fully virtual augmented reality content displayed by a head-mounted display. Control circuitry overlays computer-generated elements onto the environment to indicate wireless-connection and link status between external devices.
The device identifies external devices in the environment by product type and location using sensors. The sensors include camera/image recognition, depth sensors and SLAM, radio signals such as ultra-wideband, millimeter wave, Bluetooth, and WiFi, and also audio or ultrasonic exchange and other markers or codes on external devices.
In response to touch and/or gesture input, the control circuitry sends control signals to establish or break wireless communication links. The device streams or shares content between the electronic device and external devices in response to the input, and visual element characteristics, menus, or text change to guide user actions and indicate link type, including different visual indications for different wireless technologies.
Claims Coverage
The provided independent claims are clm-00001, clm-00010, and clm-00015. Across these independent claims, the inventive features focus on gesture-based interaction detected by cameras in a head-mounted device, gesture-responsive on-display visuals, and wireless streaming/sharing or link control to an electronic device in response to the gesture.
Finger pointing gesture to stream content to an electronic device
A head-mounted device having a head-mounted display configured to display images of a real-world environment that includes an electronic device, and a camera configured to gather gesture input comprising a finger pointing gesture towards the electronic device, wherein content is streamed to the electronic device in response to the gesture input.
Air gesture between electronic devices to share content
A head-mounted device having a first camera configured to capture a live video feed of an environment that includes first and second electronic devices, a second camera configured to gather air gesture input in the air between the first and second electronic devices, and a head-mounted display configured to display the live video feed of the environment, wherein content is shared between the first and second electronic devices in response to the air gesture input.
Infrared finger swipe gesture in the air to stream display content wirelessly
A head-mounted device having an infrared camera configured to detect a hand gesture in the air, wherein the hand gesture comprises a finger swipe gesture towards an electronic device, a head-mounted display configured to display content, and wireless communication circuitry with which the display content is streamed to the electronic device in response to the hand gesture.
The independent claims collectively cover head-mounted display of real-world or live video environment images together with gesture input detected by cameras, where the detected gesture triggers wireless streaming or sharing of content between the head-mounted device and an electronic device, with further dependents refining gesture type, camera types, and gesture-responsive visual overlays.
Stated Advantages
Documented Applications
No documented applications found
Interested in licensing this patent?