Apparatus and method for processing streaming data and forming visualizations thereof
Inventors
Anchlia, Charu • Thomas, Sushil
Assignees
Publication Number
US-11108661-B1
Publication Date
2021-08-31
Expiration Date
2039-02-20
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Abstract
A machine has a bus and a network interface circuit to receive different data streams from a network. The network interface circuit is connected to the network and the bus. A processor is connected to the bus. A memory is connected to the bus. The memory stores instructions executed by the processor to continuously increment aggregate functions associated with data parameters within the different data streams. Visualizations of the different data streams are periodically updated on different client devices connected to the network.
Core Innovation
The invention provides a machine and method for processing streaming data and forming visualizations thereof. The machine includes a bus, a network interface circuit connected to the network and the bus, a processor connected to the bus, and a memory connected to the bus. The memory stores instructions executed by the processor to continuously increment aggregate functions associated with data parameters within different data streams that are received from the network. Visualizations of these different data streams are periodically updated on different client devices connected to the network.
The invention addresses the challenge of visualizing streaming data, which is a continuous sequence of data records such as social media streams, log files, player activity, financial data, geospatial information, and telemetry. The problem is that streaming data is massive and constantly evolving, making traditional querying and visualization methods ineffective since waiting for the entire data set to be queried before displaying results is not user friendly. There is a need to intelligently present incremental results of streaming data to provide users and businesses with immediate answers that reflect the constantly changing 'right now' state.
Claims Coverage
The patent includes multiple independent claims covering a machine and a method for processing streaming data with specific features related to visualizations and aggregation.
Continuous aggregation of data parameters in streaming data
The machine or method continuously increments aggregate functions associated with data parameters within different data streams received from a network.
Visualization priority threshold tuned to visualization type
A visualization priority threshold is defined and tuned depending on the type of visualization. This threshold may be an amount of data collected or a time period and is used to determine when visualizations are updated, providing near continuous updates for heat map visualizations, and non-continuous updates for bar or line chart visualizations.
Periodic updated visualizations on client devices
Visualizations of the different data streams are periodically updated on different client devices connected to the network when the visualization priority threshold is reached.
Management of configuration parameters with different data stream servers
The machine or method handles configuration parameters with the different data stream servers connected to the network.
Tracking of currently executing queries and active data consumers
The machine or method tracks currently executing queries and currently active data consumers of the different data streams.
Managing requests from multiple data stores and multiple consumers
The machine or method manages requests for data from multiple data stores as well as from multiple consumers.
Use of aggregate functions including sum, count, minimum, and maximum
Aggregate functions include sum, count, minimum, and maximum to process streaming data.
Combining aggregate functions to compute statistical measures
Aggregate functions are combined to compute statistical measures such as average, standard deviation, and variance.
Incorporating aggregate functions and statistical measures in visualizations
Aggregate functions and statistical measures are incorporated into the visualizations of the data streams to enhance their meaning.
The claims collectively cover a system and method for processing, aggregating, and visualizing streaming data through continuous aggregation, tunable visualization update thresholds based on visualization type, management of queries and consumers, and integration of statistical measures in visualizations.
Stated Advantages
Enables immediate answers by continuously processing and aggregating streaming data rather than waiting for complete data sets.
Mitigates confusing or aesthetically unpleasing visualizations by tuning the visualization update frequency based on visualization type using a visualization priority threshold.
Allows efficient use of resources by tracking and managing active queries and consumers, and shared query runners and data stores among multiple clients.
Supports different types of aggregate functions and statistical computations, allowing for more meaningful data representations.
Differentiates data display behavior between visual creation and visualization consumption, enhancing user experience by pausing visualization updates during editing but continuing data aggregation to ensure data integrity.
Documented Applications
Visualization of various streaming data sources including social media streams, log files, in-game player activity, financial data, geospatial information, and telemetry information.
Online fraud analysis visualization showing server status codes, click fraud activity by city, and malicious user accounts.
TV channel viewing events tracking to identify the most watched channels over time, with incremental update heat maps.
Dashboards comprising multiple visualizations that consume streaming data for immediate and ongoing analysis, supporting multiple clients and queries.
Interested in licensing this patent?