You build pipelines in Control Hub to define how data flows from origin to destination systems and how the data is processed along the way.
In Control Hub, you can build Data Collector, Transformer, and Transformer for Snowflake pipelines. To choose which type of pipeline to build, you need to understand how they are similar and different.
You select the authoring engine to use when you create a connection, or a Data Collector or Transformer pipeline or pipeline fragment. Transformer for Snowflake pipelines do not require an authoring engine.
When you create or edit a pipeline or pipeline fragment, Control Hub displays the pipeline canvas. Use the pipeline canvas to build the pipeline or fragment.
A pipeline label identifies similar pipelines or pipeline fragments. Use pipeline labels to easily search and filter published pipelines and fragments when viewing them in the Pipelines or Fragments views. You cannot use pipeline labels to search and filter draft pipelines and fragments.
A typical pipeline or pipeline fragment development cycle involves iterative changes. Control Hub maintains the version history for each pipeline and fragment.
Create a pipeline to define how data flows from origin to destination systems and how the data is processed along the way.
You manage pipelines and pipeline fragments in the same way.