- Overview
You build pipelines in Control Hub to define how data flows from origin to destination systems and how the data is processed along the way.
- Comparing StreamSets Pipelines
In Control Hub, you can build Data Collector, Transformer, and Transformer for Snowflake pipelines. To choose which type of pipeline to build, you need to understand how they are similar and different.
- Authoring Engine
You select the authoring engine to use when you create a connection, or a Data Collector or Transformer pipeline or pipeline fragment. Transformer for Snowflake pipelines do not require an authoring engine.
- Pipeline Canvas
When you create or edit a pipeline or pipeline fragment, Control Hub displays the pipeline canvas. Use the pipeline canvas to build the pipeline or fragment.
- Pipeline Labels
A pipeline label identifies similar pipelines or pipeline fragments. Use pipeline labels to easily search and filter published pipelines and fragments when viewing them in the Pipelines or Fragments views. You cannot use pipeline labels to search and filter draft pipelines and fragments.
- Version History
A typical pipeline or pipeline fragment development cycle involves iterative changes. Control Hub maintains the version history for each pipeline and fragment.
- Creating a Pipeline
Create a pipeline to define how data flows from origin to destination systems and how the data is processed along the way.
- Validation
- Managing Pipelines and Fragments
You manage pipelines and pipeline fragments in the same way.
- Previewing Pipelines and Fragments
- Troubleshooting