Flowster UIRecorder
- wiki
Prequisites
Server Settings
User Account Control should be disabled (to allow the start of a process as a different user).
Local Security Policy
User whose active session ID will be used for ‘Connect To UIRecorder’ activity must be added to the following security privileges. In order to do this, log in to the remote server with a user with elevated privileges and go to Control Panel-> Administrative Tools -> Local Security Policy. When Local Security Policy opens, go to Local policies -> User Rights Assignment and add the desired user to the following:
- Act as part of the operating system
- Create a token object
- Log on as a batch job
- Replace a process level token
Local Users and Groups
User whose active session ID will be used for ‘Connect To UIRecorder’ activity must be added to the local administrators group.
Activities
- Click
- Connect To UIRecorder
- Disconnect From UIRecorder
- Double-Click
- Exists
- Extract Text
- Type Text
- Set Active Window
- Show Desktop
- Wait Vanish
Connect To UIRecorder
This activity creates a UI Recorder session.
Activity Parameters
The Connect to UIRecorder activity parameters can be provided by manual inserted values or via IN arguments or variables:
Parameters:
- ClientHash (text box editor type) (type: string): enter the RestAPI client hash code (the RestAPI client can be defined in Flowster Administrator – Integrator Page, for more info click here). This parameter is only needed when the workflow is executed on an Execution Agent. Leave empty if the execution is local (Designer execution).
- Password (password editor type) (type: string): insert the user password defined for the RestAPI client.
- Password Binding (text box editor type) (type: string): bind to a variable containing the encrypted password for the connection. (This parameter is used only when the user wants to send an encrypted password from outside the workflow, for example Flowster Portal).
- Session ID (text box editor type) (type: UInt32): specify an active session iD returned by 'Connect To Remote Desktop' activity. If no user session ID is specified, the first active user session ID will be used.
- Timeout (text box editor type) (type: UInt32): specify the number of minutes to wait for the operation. The Timeout parameter is optional to be changed, by default providing a 1 minute wait.
- Username (text box editor type) (type: string): specify a user which has rights over the RestAPI client (also defined on the RestAPI client from Administrator – Integrator Page – select the client, assign the rights and a password in the Security tab).
The Read Only Output variable are the possible output values that the activity will provide:
- Connection (type: object): outputs a UIRecorder Connection. This parameter should be used as input for all Connection parameters used for activities placed under UIRecorder category.
Disconnect From UIRecorder
This activity disconnects from the specified UIRecorder session.
Activity Parameters
The Disconnect From UIRecorder activity parameters can be provided by manual inserted values or via IN arguments or variables:
Parameters:
- Connection (text box editor type) (type: string): the Connection object - bind to the output of a Connect To UIRecorder activity.
Click
This activity executes a single click on a recorded item.
Requirements:
- The pattern should exist on the screen when the action will be made
Parameters:
- Click Duration (text box editor type) (type: Int32): if desired, specify the duration of the click in milliseconds.
- Connection (text box editor type) (type: Object): bind this parameter to the output from 'Connect To UIrecorder' activity.
- Delay After (text box editor type) (type: Int32): if desired, specify the delay after the click in milliseconds.
- Delay Before (text box editor type) (type: Int32): if desired, specify the delay before the click in milliseconds.
- Mouse Button (combo box editor type) (type: string): select the mouse button action. By default, the Left Click option will be selected, but Right Click is also available.
- Offset X (password editor type) (type: string): specify the pointer's offset value on the X axis.
- Offset Y (password editor type) (type: string): specify the pointer's offset value on the Y axis.
NOTE: These parameters, Offset X and Offset Y (the coordinates are pixels and they will be specified by integer values), can be provided if the exact screen coordinates of the item are known, otherwise the fields can be left empty
- Pattern File (text box editor type) (type: string): enter the full path to the pattern file of type PNG that will be searched on the screen and if found it will be clicked, This parameter takes precedence over 'Selected Pattern' parameter.
- Selected Pattern (custom selection pattern editor type) (type: custom): this field provides the user the opportunity to take a screen capture while developing the workflow from the Designer. By clicking the
button, the recorder will be opened and screen capturing will become available.
NOTE: the Designer will be put in background during this operation and it will not be visible on the screen or in the taskbar. After taking the capture, the user will be asked to select the point where the click should be made (in the example below the click will be made on the Log in):
If no point is desired to be specified, click the OK button (by default, for this case, the Recorder will click on the middle of the pattern during the playback).
The Read Only Output variable are the possible output values that the activity will provide:
- Output (type: Boolean): outputs True if the operation succeeded or False otherwise.
Double-Click
This activity executes a double click on a recorded item.
Requirements:
- The pattern should exist on the screen when the action will be made
Parameters:
- Connection (text box editor type) (type: Object): bind this parameter to the output from 'Connect To UIrecorder' activity.
- Delay After (text box editor type) (type: string): if desired, specify the delay after the double click operation in milliseconds.
- Delay Before (text box editor type) (type: string): if desired, specify the delay before the double click action, in milliseconds.
- Offset X (password editor type) (type: string): specify the pointer's offset value on the X axis.
- Offset Y (password editor type) (type: string): specify the pointer's offset value on the Y axis.
NOTE: These parameters, Offset X and Offset Y (the coordinates are pixels and they will be specified by integer values), can be provided if the exact screen coordinates of the item are known, otherwise the fields can be left empty
- Pattern File (text box editor type) (type: string): enter the full path to the pattern file of type PNG that will be searched on the screen and if found it will be double-clicked, This parameter takes precedence over 'Selected Pattern' parameter.
- Selected Pattern (custom selection pattern editor type) (type: custom): this field provides the user the opportunity to take a screen capture while developing the workflow from the Designer. By clicking the button, the recorder will be opened and screen capturing will become available.
NOTE: the Designer will be put in background during this operation and it will not be visible on the screen or in the taskbar. After taking the capture, the user will be asked to select the point where the click should be made (in the example below the click will be made on the Log in):
If no point is desired to be specified, click the OK button (by default, for this case, the Recorder will double-click on the middle of the pattern during the playback).
The Read Only Output variable are the possible output values that the activity will provide:
- Output (type: Boolean): outputs True if the operation succeeded or False otherwise.
Exists
This activity checks if the pattern exists on the screen.
Requirements:
- The pattern should exist on the screen when the action will be made
Parameters:
- Connection (text box editor type) (type: Object): bind this parameter to the output from 'Connect To UIrecorder' activity.
- Pattern File (text box editor type) (type: string): enter the full path to the pattern file of type PNG that will be searched on the screen.This parameter takes precedence over 'Selected Pattern' parameter.
- Selected Pattern (custom selection pattern editor type) (type: custom): this field provides the user the opportunity to take a screen capture while developing the workflow from the Designer. By clicking the button, the recorder will be opened and screen capturing will become available.
NOTE: the Designer will be put in background during this operation and it will not be visible on the screen or in the taskbar. After taking the capture, the user will be asked to select the point where the click should be made (in the example below the click will be made on the Log in):
If no point is desired to be specified, click the OK button.
The Read Only Output variable are the possible output values that the activity will provide:
- Output (type: Boolean): outputs True if the operation succeeded or False otherwise.
Extract Text
This activity extracts the text from a given pattern.
Parameters:
- Connection (text box editor type) (type: Object): bind this parameter to the output from 'Connect To UIrecorder' activity.
- Pattern File (text box editor type) (type: string): enter the full path to the pattern file of type PNG that will be searched on the screen.This parameter takes precedence over 'Selected Pattern' parameter.
- Selected Pattern (custom selection pattern editor type) (type: custom): this field provides the user the opportunity to take a screen capture while developing the workflow from the Designer. By clicking the button, the recorder will be opened and screen capturing will become available.
NOTE: the Designer will be put in background during this operation and it will not be visible on the screen or in the taskbar. After taking the capture, the user will be asked to select the point where the click should be made (in the example below the click will be made on the Log in):
If no point is desired to be specified, click the OK button.
The Read Only Output variable are the possible output values that the activity will provide:
- Output (type: string): outputs the extracted text as string.
Type Text
This activity sends characters to the application.
Parameters:
- Connection (text box editor type) (type: Object): bind this parameter to the output from 'Connect To UIrecorder' activity.
- Delay (text box editor type) (type: Int32): specify the delay before text typing, in seconds. By default, a value of 2 seconds will be provided.
- Send Key Combination (combo box editor type) (type: boolean): specify if the activity should just insert a text or if it should send a key combination (e.g. send ENTER).
- examples of key combinations:
- {ENTER} - for ENTER
- {%} - for ALT
- {^} - for CTRL
- {+} - for SHIFT
- ^(c) - for CTRL+C (copy)
- ^(v) - for CTRL+V (paste)
- examples of key combinations:
- Text (text box editor type) (type: string): specify the text to be typed in the application.
NOTE: double-escape special characters (e.g. for '\\n' type '\\\n' or @'\\n' ).
The Read Only Output variable are the possible output values that the activity will provide:
- Output (type: Boolean): outputs True if the operation succeeded or False otherwise.
Set Active Windows
This activity brings a process window on top.
Parameters:
- Connection (text box editor type) (type: Object): bind this parameter to the output from 'Connect To UIrecorder' activity.
- Process Name (text box editor type) (type: string): specify the name of the process that will be on top.
- Process Window Title (text box editor type) (type: string): specify the window title if there is more than one process with the same name (optional).
The Read Only Output variable are the possible output values that the activity will provide:
- Output (type: Boolean): outputs True if the operation succeeded or False otherwise.
Show Desktop
This activity imitates the Show Desktop button's action, by hiding/showing windows.
Parameters:
- Connection (text box editor type) (type: Object): bind this parameter to the output from 'Connect To UIrecorder' activity.
The Read Only Output variable are the possible output values that the activity will provide:
- Output (type: Boolean): outputs True if the operation succeeded or False otherwise.
Wait Vanish
This activity waits for the pattern to disappear from the screen.
Requirements:
- The pattern should exist on the screen when the action will be made
Parameters:
- Connection (text box editor type) (type: Object): bind this parameter to the output from 'Connect To UIrecorder' activity.
- Pattern File (text box editor type) (type: string): enter the full path to the pattern file of type PNG that will be searched on the screen.This parameter takes precedence over 'Selected Pattern' parameter.
- Timeout (text box editor type) (type: UInt32): specify the number of seconds to wait for the operation.
- Selected Pattern (custom selection pattern editor type) (type: custom): this field provides the user the opportunity to take a screen capture while developing the workflow from the Designer. By clicking the button, the recorder will be opened and screen capturing will become available.
NOTE: the Designer will be put in background during this operation and it will not be visible on the screen or in the taskbar. After taking the capture, the user will be asked to select the point where the click should be made (in the example below the click will be made on the Log in):
The Read Only Output variable are the possible output values that the activity will provide:
- Output (type: Boolean): outputs True if the operation succeeded or False otherwise.