Generating and reusing transformations for evolving schema mapping
Inventors
Roth, Sharon • Ilyas, Ihab F. • Bruckner, Daniel Meir • Goldin, Gideon
Assignees
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Publication Number
US-10860548-B2
Publication Date
2020-12-08
Expiration Date
Abstract
A system and method of use resolves the frustration of repeated manual work during schema mapping. The system utilizes a transformation graph—a collection of nodes (unified attributes) and edges (transformations) in which source attributes are mapped and transformed. The system further leverages existing mappings and transformations for the purpose of suggesting to a user the optimal paths (i.e., the lowest cost paths) for mapping new sources, which is particularly useful when new sources share similarity with previously mapped sources and require the same transformations. As such, the system also promotes an evolving schema by allowing users to select which unified attributes they want to include in a target schema at any time. The system addresses the technical challenge of finding optimal transformation paths and how to present these to the user for evaluation.
Core Innovation
The invention provides computer assisted mapping of source attributes of an unmapped data source into an existing transformation graph that evolves over time. The transformation graph maps source attributes from at least one data source to nodes within the transformation graph, and the transformation graph includes edges which represent transformations between the nodes. The transformation graph allows for building reusable transformation paths.
For a second data source that is distinct from the at least one data source, the system selects one or more source attributes and checks for an exact match between each selected source attribute and existing nodes within the transformation graph. When an exact match is found, the matched source attribute is automatically mapped to the matched node, and when an exact match is not found, a new node is created in the transformation graph and the unmatched source attribute is mapped to the new node.
After creating or identifying the node for each selected source attribute, the system identifies existing nodes in the transformation graph that are similar to the new node. A similar node is selected, a cost is calculated for each path from the new node to the selected node, and all paths are presented for user selection in order of calculated cost. After receiving user selection of one of the presented paths, a new edge is created from the new node to a first existing node sequentially in the selected path, thereby mapping the source attributes of the second data source to the transformation graph.
Claims Coverage
The document describes two independent claims covering a method and a computer system that enable computer assisted mapping of source attributes from a distinct unmapped data source into an evolving transformation graph, using exact match, similar-node selection, cost-ordered path presentation, and user-selected edge creation.
Computer assisted mapping into an evolving transformation graph with reusable transformation paths
Operating a computer system that stores an evolving transformation graph of nodes with edges representing transformations between nodes, where the transformation graph allows building reusable transformation paths.
Exact-match node mapping with automatic new node creation
For each selected source attribute from the second data source, checking for an exact match between the selected source attribute and existing nodes within the transformation graph, automatically mapping when an exact match is found, and when an exact match is not found creating a new node in the transformation graph and mapping the unmatched source attribute to the new node.
Similarity-based node selection and cost-ordered path presentation for user selection
Identifying existing nodes in the transformation graph that are similar to the new node, selecting one of the identified similar nodes, calculating a cost for each path from the new node to the selected node, and presenting for user selection all paths in order of calculated cost.
User-selected path integration via new edge creation sequentially in the selected path
Receiving user selection of one of the presented paths and creating a new edge from the new node to a first existing node sequentially in the selected path, thereby mapping the source attributes of the second data source to the transformation graph.
The core coverage combines exact-match mapping or new node creation, similarity-based selection, cost calculation for paths, presentation of paths ordered by cost for user selection, and creation of new edges sequentially in the selected path to integrate the second data source into an evolving transformation graph with reusable transformation paths.
Stated Advantages
Enables building reusable transformation paths in an evolving transformation graph.
Documented Applications
[Procedural detail omitted for safety] Computer assisted mapping of source attributes from a second distinct unmapped data source into an existing transformation graph.
Exporting selectable subsets of unified attributes at any time and querying the exported schema (e.g., via API/SQL) [procedural detail omitted for safety].
Interested in licensing this patent?