Image Added

Prequisites

Java Installation

...

User whose active session ID will be used for ‘Connect To UIRecorder’ activity must be added to the local administrators group.

Activities

• Click
• Connect To UIRecorder
• Disconnect From UIRecorder
• Double-Click
• Exists
• Right-Click
• Type Text
• Wait Vanish

Connect To UIRecorder

This activity creates a UI Recorder session. 

...

• ClientHash (text box editor type) (type: string): enter the RestAPI client hash code (the RestAPI client can be defined in Flowster Administrator – Integrator Page, for more info click here). This parameter is only needed when the workflow is executed on an Execution Agent. Leave empty if the execution is local (Designer execution).
• Password (password editor type) (type: string): insert the user password defined for the RestAPI client.
• Password Binding (text box editor type) (type: string): bind to a variable containing the encrypted password for the connection. (This parameter is used only when the user wants to send an encripted password from outside the workflow, for example Flowster Portal).
• Session ID (text box editor type) (type: UInt32): specify an active session iD returned by 'Connect To Remote Desktop' activity. If no user session ID is specified, the first active user session ID will be used.
• Timeout (text box editor type) (type: UInt32): specify the number of minutes to wait for the operation. The Timeout parameter is optional to be changed, by default providing a 1 minute wait.
• Username (text box editor type) (type: string): specify a user which has rights over the RestAPI client (also defined on the RestAPI client from Administrator – Integrator Page – select the client, assign the rights and a password in the Security tab).

...

• The pattern should exist on the screen when the action will be made

Image Modified

Parameters:

• Connection (text box editor type) (type: Object): bind this parameter to the output from 'Connect To UIrecorder' activity.
• Offset X (password editor type) (type: string): specify the pointer's offset value on the X axis.
• Offset Y (password editor type) (type: string): specify the pointer's offset value on the Y axis.

...

• Pattern File (text box editor type) (type: string): enter the full path to the pattern file of type PNG that will be searched on the screen and if found it will be clicked, This parameter takes precedence over 'Selected Pattern' parameter.
• Selected Pattern (custom selection pattern editor type) (type: custom): select a pattern from the screen.  

NOTE: In order to open the snipping tool to select a pattern, click the editor icon and select an image from the screen. After the selection is done, the Select Offset Point window will open allowing you to set the Click point. This will provide Offset X and Offset Y values for the pattern. Click on OK button to close this window and return to Designer.

...

• this field provides the user the opportunity to take a screen capture while developing the workflow from the Designer. By clicking the Image Addedbutton, the recorder will be opened and screen capturing will become available.

NOTE: the Designer will be put in background during this operation and it will not be visible on the screen or in the taskbar. After taking the capture, the user will be asked to select the point where the click should be made (in the example below the click will be made on the Log in):

Image Added

If no point is desired to be specified, click the OK button (by default, for this case, the Recorder will click on the middle of the pattern during the playback).

The Read Only Output variable are the possible output values that the activity will provide:

• Output (type: Boolean): outputs True if the operation succeeded or False otherwise. 
  

Right-Click

This activity executes a right click on a recorded item.

Requirements:

• The pattern should exist on the screen when the action will be made

Image Added

Parameters:

• Connection (text box editor type) (type: Object): bind this parameter to the output from 'Connect To UIrecorder' activity.
• Offset X (password editor type) (type: string): specify the pointer's offset value on the X axis.
• Offset Y (password editor type) (type: string): specify the pointer's offset value on the Y axis.

NOTE: These parameters, Offset X and Offset Y (the coordinates are pixels and they will be specified by integer values), can be provided if the exact screen coordinates of the item are known, otherwise the fields can be left empty

• Pattern File (text box editor type) (type: string): enter the full path to the pattern file of type PNG that will be searched on the screen and if found it will be right-clicked, This parameter takes precedence over 'Selected Pattern' parameter.
• Selected Pattern (custom selection pattern editor type) (type: custom): this field provides the user the opportunity to take a screen capture while developing the workflow from the Designer. By clicking the Image Addedbutton, the recorder will be opened and screen capturing will become available.

NOTE: the Designer will be put in background during this operation and it will not be visible on the screen or in the taskbar. After taking the capture, the user will be asked to select the point where the click should be made (in the example below the click will be made on the Log in):

Image Added

If no point is desired to be specified, click the OK button (by default, for this case, the Recorder will double-click on the middle of the pattern during the playback).

The Read Only Output variable are the possible output values that the activity will provide:

• Output (type: Boolean): outputs True if the operation succeeded or False otherwise. 

Wait Vanish