Workflow Components and Operation

Introduction

The Workflows feature allows for ETLs to be automatically triggered with dependency on multiple combinations of data sources surpassing predefined quality score thresholds.

Workflow Components and Operation

The bulleted numbers below correspond with the numbered callouts in the below screenshot.

1. Scheduled Run Time

The Schedule Run Time is used in conjunction with the Alerts. Alerts can be set to send specified users an email notification if the last ETL in a Workflow doesn’t trigger by the designated Scheduled Run Time. In the above screenshot, the last ETL in the example Workflow would be ‘AmultiPerfPipe_copy5’.

2. Data Source & ETL Parameters

When creating Workflows, you must select Data Sources that are already set up in the platform. These Data Sources will also be found in the Sources tab in the blue left-hand navigation pane. The highlighted portion in the above screenshot is the parameter that is used when setting up an ETL so the ETL knows which file to process when triggered.

• If you click on the parameter name which is highlighted, it will automatically save to your clipboard.
• This parameter name can also be found in the Settings tab in the Manage screen for any Source.