Desktop Actions
Introduction
The Desktop Actions feature in Autom Mate enables Mate Agent to perform various actions on a computer, such as accessing websites, clicking specific areas with the mouse, entering data, and more. These actions replicate the user interactions that end-users perform on their computers.
What is Desktop Action?
The purpose of the Desktop Actions component is to provide users with a powerful toolset to automate various desktop activities, improving efficiency and reducing manual tasks in computer workflows.
How To Use
To create a flow for the record capture process, you can access the list of actions from three different locations:
Autom Workspace
Click the "+ or drop here" button to reveal library categories.
Select the "UI ACTION" category.
Click on the "DESKTOP ACTIONS" button to access the list of available actions.
Add desired actions to the flow by clicking on them.
Desktop Screen Preview
Click on the "FULL SCREEN" button.
The list of actions will appear on the right side of the screen.
Add actions to the flow by clicking on them.
Desktop Recorder
Click on the "DESKTOP ACTIONS" button to access the list of available actions.
Add actions to the flow by clicking on them.
Scope
Description: Defines the scope of actions to be performed within the automation flow.
Purpose: This action sets the initial step for UI automation, specifying the range of actions to be executed.
Usage:
Drag and Drop: Place the "Scope" action onto the flow screen.
Action Control Center: Configure the waiting time in milliseconds within the Action Control Center.
Start Recording: Initiate the recording process by clicking the "SET RECORDING" button.
Input Fields:
None
Output Fields:
None
Crop Image
Description: Selects and captures a specific portion of an image.
Purpose: This action is used in UI automation to isolate or manipulate a particular region of an image.
Usage:
Helpful for tasks requiring precise image extraction or manipulation within the automation flow.
Input Fields:
None
Output Fields:
None
Find & Click
Description: Locates and interacts with a UI element by simulating a mouse click.
Purpose: This action triggers actions like opening menus, submitting forms, or navigating to different pages.
Usage:
Essential for UI automation tasks requiring interaction with specific elements on a page.
Input Fields:
None
Output Fields:
None
Find & Input
Description: Locates a text input field and enters text into it.
Purpose: Essential for automating data entry tasks, such as filling out login forms or search boxes.
Usage:
Enables automation of text input in fields requiring user interaction.
Input Fields:
String Value : Any website or shortcut
Output Fields:
None
Get Text
Description: Extracts text content from a specific UI element.
Purpose: Commonly used to retrieve text information from web pages, application windows, or dialog boxes.
Usage:
Retrieves text for further processing or validation within the automation flow.
Input Fields:
None : Area selection
Output Fields:
None
Hover
Description: Simulates moving the mouse cursor over a UI element without clicking.
Purpose: Useful for triggering dropdown menus, tooltips, or revealing additional information.
Usage:
Initiates actions based on hovering over specific elements without actual clicks.
Input Fields:
None
Output Fields:
None
Key Combination
Description: Simulates pressing a combination of keys, such as Ctrl + C or Ctrl + V.
Purpose: Automates keyboard shortcuts or key combinations for specific tasks in applications.
Usage:
Executes key combinations within the automation flow for enhanced efficiency.
Input Fields:
Any key combination like cmd command or etc.
Output Fields:
None
Key Press
Description: Simulates pressing a single key on the keyboard.
Purpose: Used to automate typing individual keys, such as letters, numbers, or function keys.
Usage:
Inputs single key presses as required by the automation flow.
Input Fields:
None
Output Fields:
None
Key Tab
Description: Simulates pressing the "Tab" key on the keyboard.
Purpose: Often used for keyboard-based navigation within forms or fields.
Usage:
Navigates through form fields or UI elements using the "Tab" key.
Input Fields:
None
Output Fields:
None
Pagination
Description: Navigates between multiple pages or sections of content.
Purpose: Automates moving to the next or previous page for interacting with data on different pages.
Usage:
Controls navigation through paginated content within the automation flow.
Input Fields:
None
Output Fields:
None
Pagination Item
Description: Interacts with specific items or links within a paginated list.
Purpose: Allows clicking on a particular item within a paginated list, such as selecting search results.
Usage:
Enables interaction with individual items in a paginated list for further actions.
Input Fields:
None
Output Fields:
None
Post Pagination
Description: Performs actions after pagination, such as scrolling or resetting.
Purpose: Ensures automation actions immediately after navigating to a new page.
Usage:
Executes actions required after moving to a new page within the automation flow.
Input Fields:
None
Output Fields:
None
Scroll Down
Description: Scrolls the content of a page or window downwards.
Purpose: Navigates or views additional content not initially visible on the screen.
Usage:
Scrolls down within a page or window for accessing hidden or lower content.
Input Fields:
None
Output Fields:
None
Scroll Up
Description: Scrolls the content of a page or window upwards.
Purpose: Returns to the top of a page or previous content.
Usage:
Scrolls up within a page or window for reaching top or earlier content.
Input Fields:
None
Output Fields:
None
Smooth Scroll
Description: Provides a smoother scrolling motion compared to regular scrolling.
Purpose: Creates a user-friendly scroll effect, such as smoothly scrolling through images in a gallery.
Usage:
Enhances the visual experience by smoothly scrolling through content.
Input Fields:
None
Output Fields:
None
Wait
Description: Introduces a pause or delay in the automation flow.
Purpose: Controls timing, waiting for elements to load or processes to complete before proceeding.
Usage:
Delays the automation flow for a specified duration.
Input Fields:
Delay Input
Output Fields:
None
These actions facilitate the creation of automation flows for UI interactions, allowing for precise control and manipulation of elements within the designated scope.
Additional Tips
Last updated
