Creating a Pipeline
Create a pipeline to define how data flows from origin to destination systems and how the data is processed along the way.
You can create a new pipeline in one of the following ways:
- In the top toolbar, click .
- In the Navigation panel, click Add icon:
.
, and then click the
Then, complete the following steps in the pipeline wizard:
Define the Pipeline
Define the pipeline essentials, including the pipeline name, the type of engine for the pipeline, and how to start building the pipeline.
Important: Before you can define a Data Collector
or Transformer
pipeline, you must deploy and launch an engine. For instructions, see Set up a Deployment.
Configure the Pipeline
Configure the initial content for the pipeline and the authoring engine to use for designing Data Collector or Transformer pipelines.
Important: Before you can select an authoring engine, you must deploy
and launch a StreamSets engine. For instructions, see Set up a Deployment.
Share the Pipeline
By default, the pipeline can only be seen by you. Share the pipeline with other users and groups to grant them access to it.