Pipelines Overview

Transformer for Snowflake pipelines enable you to process Snowflake data without writing a SQL query or template.

Snowflake pipelines read from and write to Snowflake. They always perform batch processing. That is, each time a Snowflake pipeline runs, all data specified in pipeline origins is processed, then the pipeline stops.

Snowflake pipelines can include the following stages:
  • One or more origins to read from Snowflake
  • Processors, as needed, to transform the data
  • One or more destinations to write to Snowflake

You can also use the features described in this chapter.

After you configure a pipeline, you create a job to run the pipeline.

For general information about Snowflake pipelines, see Understanding Snowflake Pipelines.