MySQL

Available when using an authoring Data Collector version 4.0.0 or later.

To create a MySQL connection, the MySQL Binary Log stage library, streamsets-datacollector-mysql-binlog-lib, must be installed on the selected authoring Data Collector.

For a description of the MySQL connection properties, see MySQL Connection Properties.

After you create a MySQL connection, you can use the connection in the following stages:
Engine Stages

Data Collector 4.0.0 or later

 MySQL Binary Log origin
Transformer 4.0.0 or later MySQL JDBC Table origin

MySQL Connection Properties

When creating a MySQL connection, configure the following properties on the JDBC tab:
JDBC Property Description
JDBC Connection String JDBC connection string to connect. Use the following format:

jdbc:mysql://<host>:<port>/<database>?<param1>=<value1>&<param2>=<value2>

The database name and additional parameters are optional.

For example, the following JDBC connection strings are all valid:

jdbc:mysql://example.com:3306

jdbc:mysql://example.com:3306/myDB?useSSL=true

jdbc:mysql://example.com:3306/myDB?requireSSL=true&profileSQL=true
Use Credentials

Enables entering credentials on the Credentials tab. Use when you do not include credentials in the JDBC connection string.

When using credentials, configure the following properties on the Credentials tab:

Credentials Property Description
Username MySQL username.
The required permissions and privileges depend on where you intend to use the connection:
  • Data Collector MySQL Binary Log origin - The user account must have the following privileges:
    • REPLICATION CLIENT
    • REPLICATION SLAVE
    • SELECT on included tables
  • Transformer MySQL JDBC Table origin - The user account must have the correct permissions or privileges required for the read.
Password MySQL password.
Tip: To secure sensitive information, you can use credential stores or runtime resources.