Engine Advanced Configuration

A deployment defines the advanced configuration properties for the engine. As you get started with StreamSets, the default values should work in most cases.

The available configuration properties depend on the selected engine type and version.

To modify advanced configuration properties for the engine, edit the deployment. In the Configure Engine step, click Advanced Configuration.

You can modify the following types of configuration properties for the engine:
Configuration Type Description
Data Collector or Transformer configuration General engine configuration properties.
Credential stores Credential store properties that specify the credential stores, such as AWS Secrets Manager or Microsoft Azure Key Vault, that the engine retrieves secrets from.

For more information about credential stores, see the Data Collector documentation or the Transformer documentation.
Log4j Log configuration properties for the engine.
Proxy Proxy properties that configure the engine to use a proxy server for outbound network requests.

Available for Data Collector or Transformer 5.0.0 and later.

For more information about using a proxy server, see the Data Collector documentation or the Transformer documentation.
Note: You cannot define proxy properties while the deployment is active. You must stop the deployment to change proxy properties.
Security policy Security policy properties for the engine.

For more information the Java Security Manager, see the Data Collector documentation or the Transformer documentation.
Java configuration Java configuration options used by the engine, including Java heap size and any Java options supported by the JVM.

For more information about Java configuration options, see the Data Collector documentation or the Transformer documentation.