User verification by comparing physiological sensor data with physiological data derived from facial video

Inventors

Conradie, Riaan • TERBLANCHE, Etienne

Assignees

Lifeq Global Ltd

Abstract

To participate in a health incentive program, a customer of a health-related business such as a health insurance company or medical group entity may use a physiological measurement device to report health-related activity to the business. However, a customer may report fraudulent activity to the business by allowing another party to use the physiological measurement device. In embodiments, an electronic device, a collection and validation server, and a physiological measurement device may execute methods to ensure that the user of the physiological measurement device has identified themselves properly to the business. In embodiments, the electronic device and the physiological measurement device may produce sets of physiological measurement data that are compared to determine that a user of the electronic device is the same as the user of the physiological measurement device. The electronic device may produce a set of physiological measurement data using video and image processing techniques.

Core Innovation

The invention describes a system for verifying physiological data of a user for use by a third party. The system includes a physiological measurement device and an electronic device associated with the user, and it uses facial recognition to verify that the user of the electronic device is a registered user. The system performs verification whenever the server requests the physiological data of the user, linking physiological device users to electronic device users and to a registered identity using stored identity facial feature information.

The physiological measurement device generates a first set of physiological measurement data of the user and a corresponding first set of timestamps from raw output of physiological sensors. The electronic device captures image data including a photo of a face and a photo taken concurrently with a video, and creates a second set of physiological measurement data with a corresponding second set of timestamps generated from the captured image data. A server receives the photo and processes the photo to obtain facial feature information, determines a facial match to registered identity facial feature information, and then receives and compares the first set and second set physiological measurement data based on matching criteria using the corresponding timestamps.

In response to determining that the first set of physiological measurement data matches the second set of physiological measurement data, the system sends the first set of physiological measurement data and a notification to a third party server to verify the physiological measurement device user and the electronic device user are the registered user. In one described system configuration, the first set and second set are heart rate data generated by the physiological measurement device and by the electronic device using video-derived physiological measurement. The collection-and-validation server confirms registered status using facial recognition algorithms, performs the physiological matching for data captured at the same time, and then sends a notification to the third party server and sends the physiological data for use in a health insurance benefit program.

Claims Coverage

The partial content includes three independent claims. Across these independent claims, the inventive features focus on facial recognition of a face photo to verify registered user identity, generation of physiological data sets with corresponding timestamps from a physiological measurement device and from video captured by an electronic device, comparison of the physiological data sets using matching criteria based on timestamps to confirm device-user pairing, and sending verification results to a third party server.

Overall, the independent claims require facial recognition against registered identity facial feature information, physiological data comparison between device-generated and video-derived physiological measurement data using corresponding timestamps, and transmission of matching results to a third party server for linking and verification, with one configuration further specifying use in a health insurance benefit program and video-based heart rate generation using Eulerian video magnification.

Stated Advantages

Documented Applications