Advanced Thread Pool Properties

The Data Collector configuration file includes a runner.thread.pool.size property described in Running Multiple Concurrent Pipelines.

Though the existing Data Collector configuration properties provide the configuration abilities that most users generally need, when necessary, you can add and configure advanced thread pool properties.

The following table lists the additional thread pool properties that you can add to the Data Collector configuration file. However, note that the default values used by Data Collector are typically sufficient in most cases.
Advanced Thread Pool Property Description
runner_stop.thread.pool.size Thread pool size used to force stop pipelines.

Default is the value set for the runner.thread.pool.size property.

event.executor.thread.pool.size Thread pool size used to react to pipeline events.

Default is the value set for the runner.thread.pool.size property.

manager.executor.thread.pool.size Thread pool size used to manage background processes.

Default is 4.

bundle.executor.thread.pool.size Thread pool size used to create support bundles.

Default is 1.

previewer.thread.pool.size Thread pool size used for data preview. You might increase this setting when previewing multiple pipelines at the same time.

Default is 4.
To configure an advanced thread pool property, add the property to the Data Collector configuration file.
  1. Use a text editor to edit the Data Collector configuration file, $SDC_CONF/sdc.properties.
  2. Add the advanced thread pool properties that you want to configure, then define values for each property.
  3. To enable the changes, restart Data Collector.