System and method for content selection for web page indexing
Inventors
Assignees
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Publication Number
US-10303722-B2
Publication Date
2019-05-28
Expiration Date
Abstract
An indexing system for documents such as web pages divides a document into elements, such as document object model elements. User attention data from prior interactions with the document are analyzed to determine those elements of a document that satisfy a threshold requirement of user attention. Elements meeting the user attention threshold requirement are added to a set of indexable content for the document. Furthermore, document sections are determined based on attention data and each section is indexed separately. Indexing is per section and based only on the indexable content, thereby enhancing the index relevance, increasing the efficiency of search engines and reducing spamdexing.
Core Innovation
The invention indexes a webpage by segmenting each webpage into a document object model (DOM) containing one or more DOM elements, then computing a DOM element identifier for each DOM element based on the content within that DOM element. The system determines a first subset of the DOM elements whose DOM element identifiers satisfy a content similarity threshold compared to other DOM element identifiers.
The invention uses attention history data associated with each DOM element in the first subset, where the attention history data is based on previous user interface events detected within the particular DOM element. The method combines the attention history data for the DOM elements in the first subset and compares the combined attention history data to an attention history threshold level.
In response to a determination that the combined attention history data meets the attention history threshold level, the invention indexes each DOM element of the first subset. The system provides the selected DOM elements to an indexing module when the combined attention history data for the first subset meets the attention history threshold level.
Claims Coverage
The independent claims cover an indexing method, an indexing system, and a non-transitory computer-readable medium. Across these independent claims, the inventive approach uses DOM segmentation with content-based DOM element identifiers, selection of a first subset via a content similarity threshold, and gating indexing on combined attention history derived from previous user interface events using an attention history threshold level.
Content-based DOM element identifiers and content similarity subset selection
Compute a DOM element identifier for each DOM element based on the content within the corresponding DOM element, and determine a first subset of the plurality of DOM elements having DOM element identifiers that satisfy a content similarity threshold to the DOM element identifiers of the other DOM elements.
Attention history from previous user interface events and threshold gating for indexing
Retrieve attention history data associated with each of the first subset of DOM elements, where the attention history data for each particular DOM element is based on previous user interface events detected within the particular DOM element; combine the attention history data associated with each of the first subset of DOM elements, compare the combined attention history data to an attention history threshold level; and index each of the first subset of DOM elements in response to a determination that the combined attention history data meets the attention history threshold level.
Providing indexable DOM elements to an indexing module based on combined attention-history threshold
Provide each of the first subset of DOM elements to an indexing module programmed to index the received first subset of DOM elements in response to a determination that the combined attention history data associated with the first subset of DOM elements meets the attention history threshold level.
Across the independent claims, indexing is performed only for a first subset of DOM elements that are both content-similar and attention-salient, using content-based DOM element identifiers, a content similarity threshold, combined attention history from previous user interface events, and an attention history threshold level.
Stated Advantages
Improves indexing efficiency and reduces spamdexing by excluding low-attention elements such as irrelevant side columns.
Improves search relevance by indexing DOM elements only when attention history meets an attention history threshold level.
Supports reduced spam indexing by excluding low-attention elements.
Documented Applications
Web page indexing for a document index where indexable content is selected based on attention history derived from prior user interface events.
Searching that benefits from improved search relevance through attention-gated indexing of DOM elements.
Interested in licensing this patent?