Oracle JDBC Table

The Oracle JDBC Table origin reads data from an Oracle table. The origin can read all of the columns from a table or only the specified columns from a table. To read from one or more tables using a custom query, use the JDBC Query origin.

When you configure the Oracle JDBC Table origin, you specify database connection information and any additional JDBC configuration properties you want to use. You can also use a connectionconnection to configure the origin.

You configure the table to read, and optionally define the columns to read from the table. You specify the offset column and the number of partitions used to read from the database table. The data type allowed for the offset column depends on the specified number of partitions. You can also configure an additional predicate for the query.

You can configure the origin to load data only once and cache the data for reuse throughout the pipeline run. Or, you can configure the origin to cache each batch of data so the data can be passed to multiple downstream batches efficiently. You can also configure the origin to skip tracking offsets, which enables reading the entire data set each time you start the pipeline.

You can optionally configure advanced properties such as specifying the fetch size, custom offset queries, and the JDBC driver to bundle with the pipeline.

Before you use the Oracle JDBC Table origin, install a JDBC driver.

StreamSets has tested this origin on Oracle 11g with the Oracle 19.3.0 JDBC driver.