System and method for content selection for web page indexing

Inventors

Hauser, Robert R.

Assignees

Lipari Paul • Oracle America Inc • Suboti LLC

Abstract

An indexing system for documents such as web pages divides a document into elements, such as document object model elements. User attention data from prior interactions with the document are analyzed to determine those elements of a document that satisfy a threshold requirement of user attention. Elements meeting the user attention threshold requirement are added to a set of indexable content for the document. Furthermore, document sections are determined based on attention data and each section is indexed separately. Indexing is per section and based only on the indexable content, thereby enhancing the index relevance, increasing the efficiency of search engines and reducing spamdexing.

Core Innovation

A web page indexing system selects indexable content of a web page based on interaction data tied to attention events detected within the web page content. The system retrieves web page content from a web page data store using a URL, requests interaction data associated with the URL from an interaction data store, and receives interaction data identifying one or more attention events, each based on a previous user interface event detected within the web page content and including a location within the web page where the user interface event was detected.

The system divides the web page content into a plurality of non-overlapping content sections and, for each particular content section, analyzes the locations of the attention events in the received interaction data to determine whether the particular content section is associated with one or more of the attention events. The system determines whether the particular content section is found within one or more additional web pages stored within the web page data store and, in response, analyzes locations of additional attention events associated with the one or more additional web pages and sums the number of attention events associated with the particular content section across the web page and the additional web pages.

The system adds the particular content section to indexable content when the sum of attention events is greater than a threshold of attention events, and outputs the indexable content corresponding to the web page. The system supports dividing and indexing the web page into mutually disjoint content sections, where each section’s selected elements are indexed separately, including optionally with per-section URLs.

Claims Coverage

The independent claims include a method, an apparatus, and a non-transitory computer-readable storage medium that each select indexable web page content using attention events with locations and section-based selection with threshold gating. The inventive features across the independent claims center on retrieving content by URL, obtaining attention-event interaction data, dividing into non-overlapping content sections, summing attention events across additional web pages, and adding sections to indexable content when the summed count exceeds a threshold.

Across the independent claims, the system selects indexable content by retrieving web page content by URL, obtaining attention-event interaction data with locations, dividing content into non-overlapping sections, analyzing whether sections are associated with attention events, determining presence of the same sections in additional web pages, summing attention-event counts across those pages, and adding sections to indexable content when the summed count exceeds a threshold, with output of the resulting indexable content.

Stated Advantages

Documented Applications