Processing Queue

The JDBC Multitable Consumer origin maintains a virtual queue to determine the data to process from different tables. The queue includes each table defined in the origin. When a table is to be processed by partition, multiple partitions for the table are added to the queue, limited by the Max Partitions property defined for each table configuration on the Tables tab.

The origin rotates and reorganizes the queue based on the Per Batch Strategy property. The origin processes data from the queue with the threads specified in the Number of Threads property and the Batches from Result Set property.

Below are some scenarios to show how the queue works.