My Account

When you access the My Account menu, you can configure general Control Hub settings, such as your account and browser settings. You can invite users to join your organization, or sign out of StreamSets. If you are a member of multiple organizations, you can switch between them. If you have a free trial, you can upgrade to a paid subscription.

You can also configure Snowflake credentials and Snowflake pipeline defaults through the My Account menu.

This documentation discusses the Snowflake settings. For information about general Control Hub settings, see the Control Hub documentation.

To access the My Account menu, click the My Account icon () in the top right toolbar.

Snowflake Settings

You can configure the following information in the Snowflake section of your StreamSets account settings:
Snowflake credentials
Transformer for Snowflake requires Snowflake credentials to access your Snowflake account. Once provided, the credentials are securely stored in your StreamSets account and used for all subsequent connections to Snowflake.
You can define, edit, or delete the Snowflake credentials in your StreamSets account.
Snowflake pipeline defaults
Specify defaults to use in Snowflake pipelines for the Snowflake URL, data warehouse, database, schema, and role properties.
All defaults can be updated in your StreamSets account or overridden in individual pipelines, as needed.

Snowflake Credentials

To access your Snowflake account, Transformer for Snowflake requires your Snowflake credentials. You can either define them in your StreamSets account or when you configure a pipeline.

When you do not have Snowflake credentials stored in your StreamSets account, you are asked for your credentials when you create your first Transformer for Snowflake pipeline.

To change your Snowflake credentials, you can edit or delete the Snowflake credentials in your StreamSets account. You can also update Snowflake credentials when you configure a pipeline.

When you provide your Snowflake credentials, they are validated and securely stored in your StreamSets account. Then, they are used for all subsequent connections to Snowflake.

Note: To help secure your Snowflake account, you cannot view the existing Snowflake password or private key through the Control Hub user interface. You can only view those values as you enter them.

Defining Snowflake Credentials

Use the following steps to define Snowflake credentials in your StreamSets account settings. You can also define Snowflake credentials as needed when you configure a pipeline.
  1. In the top right toolbar, click the My Account icon () and then click your user name.
  2. Click the Snowflake Settings tab.
  3. Under Snowflake Credentials, click Edit. Configure the following properties as needed, and then click Save.

    You can click Show Value to show the password or private key that you enter.

    Snowflake Credentials Property Description
    Username Snowflake user name.
    Authentication Method Authentication method to use: password or private key.
    Password Password for the Snowflake account.

    Available when using password authentication.

    Private Key Private key for the Snowflake account. Enter a PKCS#1 or PKCS#8 private key and include the key delimiters.

    For example, when entering a PKCS#8 private key, include the -----BEGIN PRIVATE KEY----- and -----END PRIVATE KEY----- key delimiters.

    Available when using private key authentication.

    Role Optional role to use when a role is not defined in the pipeline.

    When you do not specify a role in a pipeline or in this property, Snowflake uses the default role for the user. If the user has no default role, Snowflake uses the Public role. For more information, see the Snowflake documentation.

    Use to limit access to the Snowflake account. However, note that the following permissions are generally required to run Snowflake pipelines:
    • Read
    • Write
    • Create Table

Updating or Deleting Snowflake Credentials

Update Snowflake credentials as needed. For example, you might need to update the credentials after you update your Snowflake password.
Note: To update credentials, you must specify the password or private key to use.

You can also delete Snowflake credentials from the account instead of updating them. When you delete credentials without replacing them, you must provide new credentials the next time you perform a task that requires credentials, such as starting a job or previewing data. You might delete credentials when you know that the current credentials are no longer valid, but don't have new credentials available yet.

  1. In the top right toolbar, click the My Account icon () and then click your user name.
  2. Click the Snowflake Settings tab.
  3. To delete all configured properties, under Snowflake Credentials, click Delete. When asked to confirm the deletion, click Delete.
  4. To update the properties, click Edit.
  5. Configure the following properties as needed, and then click Save.
    To save your changes, you must specify the password or private key to use. You can click Show Value to show the password or private key that you enter.
    Snowflake Credentials Property Description
    Username Snowflake user name.
    Authentication Method Authentication method to use: password or private key.
    Password Password for the Snowflake account.

    Available when using password authentication.

    Private Key Private key for the Snowflake account. Enter a PKCS#1 or PKCS#8 private key and include the key delimiters.

    For example, when entering a PKCS#8 private key, include the -----BEGIN PRIVATE KEY----- and -----END PRIVATE KEY----- key delimiters.

    Available when using private key authentication.

    Role Optional role to use when a role is not defined in the pipeline.

    When you do not specify a role in a pipeline or in this property, Snowflake uses the default role for the user. If the user has no default role, Snowflake uses the Public role. For more information, see the Snowflake documentation.

    Use to limit access to the Snowflake account. However, note that the following permissions are generally required to run Snowflake pipelines:
    • Read
    • Write
    • Create Table

Snowflake Pipeline Defaults

Snowflake pipeline defaults are Snowflake connection details stored in your StreamSets account for use in all new pipelines.

Snowflake pipeline defaults are added to each new pipeline as static values that you can easily update. Subsequent changes to Snowflake pipeline defaults are not propagated to existing pipelines. You can apply the current Snowflake pipeline default values to existing pipelines at any time.

For example, say you configure the following Snowflake pipeline defaults in your StreamSets account:

When you create a new pipeline, these details are included in pipeline properties on the General tab:

If any of the default values are not appropriate for the pipeline, simply update the pipeline properties as needed.

The following table lists the Snowflake pipeline default properties and the corresponding pipeline properties where they are used:
Snowflake Pipeline Default Property Pipeline Property
Account URL Snowflake URL
Warehouse Warehouse
Database Pipeline Working Schema

The database is used in the property to specify the schema as follows: <database>.<schema>

Schema Pipeline Working Schema

The schema is used in the property as follows: <database>.<schema>

Role Role

Defining Pipeline Defaults

You can define or update Snowflake pipeline defaults in your StreamSets account.

If you do not define Snowflake pipeline defaults in your StreamSets account, the details that you specify in your first pipeline are saved in your StreamSets account as Snowflake pipeline defaults. If these details are not appropriate for your pipelines, be sure to update your Snowflake pipeline defaults in your StreamSets account.

The values that you specify for pipeline defaults are used in all new pipelines and can be applied to existing pipelines, as needed.

  1. In the top right toolbar, click the My Account icon () and then click your user name.
  2. Click the Snowflake Settings tab.
  3. Optionally configure the following properties.
    Snowflake Pipeline Default Property Description
    Account URL Default Snowflake URL to use. For example:

    https://<yourcompany>.snowflakecomputing.com

    Warehouse Default warehouse to use.
    Database Default database to use.
    Schema Default schema to use.
    Role Default role to use.
  4. To save the pipeline defaults, click Save.