SQL Server JDBC Table

The SQL Server JDBC Table origin reads data from a SQL Server table. The origin can read all of the columns from a table or only the specified columns from a table. To read from one or more tables using a custom query, use the JDBC Query origin.

When you configure the SQL Server JDBC Table origin, you specify database connection information and any additional JDBC configuration properties you want to use. You can also use a connectionconnectionconnection to configure the origin.

You configure the table to read, and optionally define the columns to read from the table. You specify the offset column and the maximum number of partitions used to read from a database table. The data type of the offset column can limit the number of partitions that the origin can use. You can also configure an additional predicate for the query.

You can configure the origin to load data only once and cache the data for reuse throughout the pipeline run. Or, you can configure the origin to cache each batch of data so the data can be passed to multiple downstream batches efficiently. You can also configure the origin to skip tracking offsets.

You can optionally configure advanced properties such as specifying the fetch size, custom offset queries, and the JDBC driver to bundle with the pipeline.

StreamSets has tested this origin on Microsoft SQL Server 2017 with the SQL Server JDBC 8.4.0 JRE8 driver.