Snowflake Table Origin

The Snowflake Table origin reads data from a single Snowflake table or view. To read from more than one table or view, use additional origins. For information about merging data from different origins, see Merging Streams.

When you configure the Snowflake Table origin, you specify the name of the table or view and the columns to read. You can define an additional predicate to limit the query that the origin performs when you run the pipeline. You can also define an additional predicate for data preview.

By default, the origin connects to Snowflake using the Snowflake pipeline properties. When needed, you can specify another database or schema to use instead.

Configuring a Snowflake Table Origin

Configure a Snowflake Table origin to read data from a single Snowflake table or view. To read from additional tables or views, use additional origins.

  1. On the General tab, configure the following properties:
    General Property Description
    Name Stage name.
    Description Optional description.
    Cache Data Caches processed data.
  2. On the Table tab, configure the following properties:
    Table Property Description
    Table Name of the table or view to read from. Use one of the following methods to define this property:
    • Manually enter - Click the Table text box. In the Overwrite Database, Schema, and Table dialog box, you can specify the database, schema, and the table or view to use, then click Save. The database or schema specified here overrides those defined in pipeline properties.
    • Explore and select - Click the Select Table icon to explore your Snowflake data and navigate to the table or view to use.
    Columns to Read Columns to include in the read. When columns are specified, the origin omits all unspecified columns from the read. When no columns are specified, the origin reads all columns.
    Use one of the following methods to define this property:
    • Manually enter - Click Add and specify a column. Click Add Another to include additional columns.
    • Explore and select - Click the Select Column icon to select the columns to use, then click Save.

      To use this option, the Table property must be defined.

    Additional Where Clause Optional WHERE clause to limit the query that the origin performs when you run the pipeline. You can specify any condition that you would place into a WHERE clause of a Snowflake SQL query.

    Do not include WHERE in the clause.

    For example, to query rows with IDs greater than 1000, enter ID > 1000.
    Additional Preview Where Clause Optional WHERE clause to limit the query that the origin performs when you preview the pipeline.

    Use to determine the subset of data that displays in preview. By carefully choosing the preview data, you can more easily verify that pipeline processing is appropriate.

    You can specify any condition that you would place into a WHERE clause of a Snowflake SQL query.

    Do not include WHERE in the clause.

    For example, to query rows with different ranges of IDs, you might enter: (ID > 1000 AND ID < 1050) OR (ID > 2000 AND ID < 2050)

    For more information about previewing data, see the Control Hub documentation.