Method and system for integrating a graphical user interface capture for automated test and retest procedures
Inventors
Gauf, Bernard • Bindas, Scott • Mursko, Matt
Assignees
Interested in licensing this patent?
MTEC can help explore whether this patent might be available for licensing for your application.
Publication Number
US-9135714-B1
Publication Date
2015-09-15
Expiration Date
Abstract
According to an embodiment of the present invention, a computer implemented system and system for capturing an image for automated test and retesting using an image capture function provided by a computer processor comprises: a capture tool, comprising at least one processor, configured to capture a screen image, a click position and user interaction; an image processing module, comprising at least one processor, configured to receive the screen image and generate a sub-image based at least in part on the click position; and a display module, comprising at least one processor, configured to display the sub-image and the user interaction to the user for generating at least one automated test step.
Core Innovation
The invention relates to a computer implemented system for capturing an image for automated test and retesting using an image capture function provided by a computer processor. The system includes a capture tool configured to capture a screen icon, a click position, and user interaction, where the user interaction identifies a mouse click button and a mouse click count. The click position, the mouse click button, and the mouse click count are associated with the screen icon, and the screen icon is captured by comparing shades of colors to identify a boundary of the screen icon.
An image processor receives the captured screen icon and generates a sub-image defined by the boundary on the screen icon and based at least in part on the click position. The click position is used as a basis for determining how the sub-image is defined within the boundary of the screen icon, and additional modules may highlight edges and use edge proximity to generate a region and identify a sub-image within a defined region.
A test flow tool provides modeling capability through an interface comprising a canvas display and a palette display. The canvas display automatically builds a corresponding test flow graphically represented on the canvas display that comprises the sub-image as defined by the boundary of the screen icon and the captured user interaction. The palette display displays a collection of modeling components for building test flows on the canvas display, so the captured image and associated interaction are incorporated into the model-driven test flow environment for automated test and retesting.
Claims Coverage
The document provides two independent claims: an independent system claim and a corresponding independent method claim. Across both independent claims, there are four main inventive features.
Capturing a screen icon with click-associated interaction via shade-based boundary detection
A capture tool comprising at least one processor captures a screen icon, a click position, and user interaction identifying a mouse click button and a mouse click count, associating the click position, mouse click button, and mouse click count with the screen icon, where the screen icon is captured by comparing shades of colors to identify a boundary of the screen icon.
Generating a click-position-based sub-image from the detected boundary
An image processor receives the captured screen icon and generates a sub-image defined by the boundary on the screen icon and based at least in part on the click position.
Modeling test flows with a canvas display and palette display
A test flow tool provides modeling capability through an interface comprising a canvas display and a palette display, where the palette display displays a collection of modeling components for building test flows on the canvas display.
Automatically building a corresponding graphical test flow on the canvas using the captured sub-image and interaction
The canvas display automatically builds a corresponding test flow graphically represented on the canvas display comprising the sub-image as defined by the boundary of the screen icon and the captured user interaction.
Both independent claims cover the same core workflow: capture a screen icon with click-associated interaction and detect a boundary by comparing shades of colors, generate a sub-image defined by that boundary and based on the click position, and automatically incorporate the resulting sub-image and captured user interaction into a model-driven test flow graphically built on a canvas display using a palette of modeling components.
Stated Advantages
Not explicitly described in patent.
Documented Applications
Not explicitly described in patent.
Interested in licensing this patent?