MySQL JDBC Table

The MySQL JDBC Table origin reads data from a MySQL table. The origin can read all of the columns from a table or only the specified columns from a table. To read from one or more tables using a custom query, use the JDBC Query origin.

When you configure the MySQL JDBC Table origin, You can also use a connectionconnectionconnection to configure the origin.

You specify the offset column and the maximum number of partitions used to read from a database table. The data type of the offset column can limit the number of partitions that the origin can use. You can also configure an additional predicate for the query.

You can configure the origin to load data only once and cache the data for reuse throughout the pipeline run. Or, you can configure the origin to cache each batch of data so the data can be passed to multiple downstream batches efficiently. You can also configure the origin to skip tracking offsets.

You can optionally configure advanced properties such as specifying the fetch size, custom offset queries, and the JDBC driver to bundle with the pipeline.

Before you use the MySQL JDBC Table origin, install a JDBC driver.

StreamSets has tested this origin on MySQL 5.7 with the MySQL Connector/J 8.0.12 driver.