Rules and Alerts Overview
You can define rules to enable capturing information about a running pipeline. You can enable an alert for any rule to be notified when the specified condition occurs.
Not valid in Data Collector Edge pipelines.
Data Collector Edge pipelines ignore any configured rules or alerts.
Rules and alerts for pipelines managed by Control Hub are triggered based on the data processed for each local pipeline instance, by the execution Data Collector that runs it. Rules and alerts for pipelines run by standalone Data Collectors are triggered based on the pipeline data that the Data Collector processes.
You can create the following types of rules:
- Metric rule - Gathers statistics about the pipeline such as pipeline idle time or error record counts. Provides an alert when enabled.
- Data rule - Gathers details about data as it passes between two stages. Can provide a meter and alert.
- Data drift rule - Gathers details about data drift as data passes between two stages. Can provide a meter and alert.
When you enable alerts, you can be informed of the alert in the following ways:
- Pipeline monitoring - All alerts display when you view the pipeline in Monitor mode.
- Webhooks - All alerts trigger all configured webhooks.
- Email - You can configure rules to send email alerts.
- Control Hub UI - Triggered alerts display on the Control Hub Alerts view and as an alert when you monitor the job running the pipeline.