Error Codes
Error Codes
This appendix describes common error codes.
EXPR_00
- Error message
EXPR_00("Invalid expression '{}': {}")
- Issue
- The expression used to define a stage or pipeline property failed to validate.
- Troubleshooting and resolution
- This error code typically displays when an expression includes a syntax error.
To resolve the issue:
- Verify that the expression fields are spelled correctly. For example,
verify that you entered
record:value
and notrecord:values
. - Verify that all required quotes are entered correctly, especially if the expression was copied and pasted. The only supported quote characters are " or '.
- Verify that all the parentheses () and curly brackets {} are positioned correctly.
- Verify that the expression is using supported functions.
- Use expression completion in the property to verify that the expression you created is available for this property. Not all properties support all available functions.
- Verify that the expression fields are spelled correctly. For example,
verify that you entered
HTTP_01
- Error message
HTTP_01("Error fetching resource. HTTP-Status: {} Reason: {}")
- Issue
- The HTTP Client origin, HTTP Client processor, HTTP Client destination, or one of the orchestration stages encountered an unsuccessful status code, that is any non-2xx status code, while fetching the requested URL.
- Troubleshooting and resolution
- To resolve the issue:
- Verify that the HTTP resource URL is correctly configured.
- Verify that the HTTP resource URL is responsive. For example, use curl to access the URL.
- Verify that pagination is correctly configured in the processor.
- Review the returned HTTP status code to determine the type of failure.
JDBC_00
- Error message
JDBC_00("Cannot connect to specified database: {}")
- Issue
-
One of the stages that use JDBC connections, such as the JDBC Query Consumer origin, Oracle CDC Client origin, or JDBC Producer destination, could not connect to the database.
- Troubleshooting and resolution
- To resolve the issue:
- Verify that you can access the server and connect to the database. You can use tools such as ping, netcat (nc), or telnet for this purpose.
- Verify that the machine running Data Collector can connect to the database.
- Verify that the correct database hostname and port number are configured in the stage.
- Verify that the JDBC driver is correctly installed as an external
library.
To install an external library, add the external library as an external resource for the deployment, as described in the Control Hub documentation.
- Verify that the user credentials are correctly entered in the Credentials tab for the stage.
JDBC_06
- Error message
JDBC_06("Failed to initialize connection pool: {}")
- Issue
-
One of the stages that use JDBC connections, such as the JDBC Query Consumer origin, Oracle CDC Client origin, or the JDBC Producer destination, could not connect to the database.
- Troubleshooting and resolution
- To resolve the issue:
- Verify that you can access the server and connect to the database. You can use tools such as ping, netcat (nc), or telnet for this purpose.
- Verify that the machine running Data Collector can connect to the database.
- Verify that the correct database hostname and port number are configured in the stage.
- Verify that the JDBC driver is correctly installed as an external library.
To install an external library, add the external library as an external resource for the deployment, as described in the Control Hub documentation.
- Verify that the user credentials are correctly entered in the Credentials tab for the stage.
JDBC_07
- Error message
JDBC_07("Invalid column mapping from field '{}' to column '{}'")
- Issue
-
One of the stages that use JDBC connections, such as the JDBC Tee processor or JDBC Producer destination, specifies a table column name that does not exist.
- Troubleshooting and resolution
- To resolve the issue:
- Use preview mode to verify the field names in the Data Collector record.
- Verify the column names in the database table.
- Verify that the Field to Column Mapping property is correctly configured and that the specified table columns exist.
JDBC_16
- Error message
JDBC_16("Table '{}' does not exist or PDB is incorrect. Make sure the correct PDB was specified")
- Issue
-
The Oracle CDC Client origin has an incorrectly configured Oracle pluggable database (PDB).
Or, one of the stages that use JDBC connections specifies an incorrect
{schema.tablename}
value, or specifies a table that does not exist. This error can also occur when the user credentials configured for the stage do not have the correct permissions to query table metadata from the database. - Troubleshooting and resolution
- To resolve the issue:
- For an Oracle CDC Client origin, verify that configuring the PDB name is required. In most cases, it is not required. Or, if the origin reads the dictionary from redo logs, verify that the specified schema and table exist.
- For other JDBC stages, verify that the specified schema and table exist.
JDBC_28
- Error message
JDBC_28("Failed to create JDBC driver, JDBC driver JAR may be missing: {}")
- Issue
- One of the stages that use JDBC connections, such as the Oracle CDC Client origin or the JDBC Producer destination, encountered an error resolving the driver class for the database.
- Troubleshooting and resolution
- To resolve the issue:
- Verify that the JDBC driver containing the driver class is correctly
installed as an external library.
To install an external library, add the external library as an external resource for the deployment, as described in the Control Hub documentation.
- Verify that the correct class name for the driver is defined in the JDBC Class Driver Name property on the Legacy Drivers tab for the stage. JDBC-4 compliant drivers usually do not require defining this property.
- Verify that the JDBC driver containing the driver class is correctly
installed as an external library.
JDBC_29
- Error message
-
JDBC_29("Query must include '{}' in WHERE clause and in ORDER BY clause before other columns.")
- Issue
-
The JDBC Query Consumer origin is configured to perform an incremental SQL query, but the offset column is not included in the WHERE or ORDER BY clause. Or, the offset column is not included as the first column in the WHERE or ORDER BY clause.
- Troubleshooting and resolution
- To resolve the issue:
- Verify that the offset column is included in both the WHERE and ORDER BY clauses.
- Verify that the offset column is included as the first column in both the WHERE and ORDER BY clauses.
JDBC_34
- Error message
JDBC_34("Query failed to execute: '{}' Error: {}")
- Issue
-
Pipeline validation encountered an error because the SQL query defined in the JDBC Query Consumer origin cannot be executed.
- Troubleshooting and resolution
- To resolve the issue, verify that the SQL query uses valid syntax and uses existing tables.
JDBC_37
- Error message
JDBC_37("Unsupported type 1111 for column")
- Issue
-
The JDBC Multitable Consumer origin, JDBC Query Consumer origin, or JDBC Lookup processor encountered an unsupported data type.
- Troubleshooting and resolution
- To resolve the issue, configure the stage to convert the data to string when possible by setting the On Unknown Type property to Convert to String on the Advanced tab.
JDBC_38
- Error message
JDBC_38("Query must include '{}' clause.")
- Issue
-
Pipeline validation encountered an error because the SQL query configured for the JDBC Query Consumer origin does not include the required WHERE and ORDER BY clauses.
- Troubleshooting and resolution
- To resolve the issue:
- Verify whether the origin should be running in incremental or full mode.
- Verify that the SQL query includes both the WHERE and ORDER BY clauses and that they are correctly defined.
- Verify that the offset column configured in the origin properties is included in the WHERE and ORDER BY clauses of the SQL query.
JDBC_51
- Error message
JDBC_51("Invalid value: {}")
- Issue
-
The JDBC Query Consumer origin is configured for incremental mode, but the Offset Column or Initial Offset property is not configured.
- Troubleshooting and resolution
- To resolve the issue:
- Verify whether the origin should be running in incremental or full mode.
- If running in incremental mode, verify that the Offset Column and Initial Offset properties are correctly configured.
JDBC_66
- Error message
-
JDBC_66("No Tables match the configuration in the origin.")
- Issue
-
One of the origins that use JDBC connections, such as the JDBC Multitable Consumer origin or the Oracle CDC Client origin, specifies a table in the table configuration that does not exist. Or, the origin does not specify the required table name.
- Troubleshooting and resolution
- To resolve the issue, verify that the origin has a correctly configured table configuration. For more information, see the Table Configuration topic for the origin.
JDBC_502
- Error message
JDBC_502("Batch size greater than maximum batch size allowed in sdc.properties, maxBatchSize: {}")
- Issue
-
The maximum batch size configured in the origin properties is greater than the Data Collector maximum batch size configured in the advanced engine configuration properties in the deployment.
- Troubleshooting and resolution
- To resolve the issue, decrease the origin maximum batch size property so that it is less than the Data Collector production.maxBatchSize property.
KAFKA_41
- Error message
KAFKA_41("Could not get partition count for topic '{}' : {}")
- Issue
-
The Kafka Multitopic Consumer or MapR Multitopic Streams Consumer origin cannot retrieve the number of partitions in the topic based on its partition list. The partition list might be empty.
- Troubleshooting and resolution
- To resolve the issue:
- Use another tool to verify that the machine running Data Collector can connect to the Kafka broker or to the MapR Streams cluster.
- For the Kafka Multitopic Consumer origin, verify that the Kafka broker URI is correctly configured in the origin.
- Verify that the topic is correctly configured in the Kafka or MapR Streams cluster.
RECORDFS_01
- Error message
RECORDFS_01("Directory '{}' does not exist")
- Issue
-
The pipeline is configured to write error records to file, but the specified directory for the error record files does not exist.
- Troubleshooting and resolution
- To resolve the issue, verify that the directory configured in the Error Records - Write to File tab in the pipeline properties exists.
SNOWFLAKE_16
- Error message
SNOWFLAKE_16("{<Snowflake SQL command>} failed: {}")
- Issue
-
The Snowflake destination encountered an error while running one of the following Snowflake SQL commands:
- DESCRIBE FILE FORMAT
- DESCRIBE TABLE
- DESCRIBE PIPE
- DESCRIBE STAGE
- USE SCHEMA
- Troubleshooting and resolution
- To resolve the issue, verify that the Database, Schema, and Snowflake File Format properties are correctly configured for the destination. The Snowflake File Format property should not be used unless recommended by StreamSets customer support.
SPOOLDIR_12
- Error message
SPOOLDIR_12("Directory '{}' does not exist")
- Issue
-
The Directory origin is configured to read files from a local directory that does not exist.
- Troubleshooting and resolution
- To resolve the issue, verify that the local directory configured in the origin exists.
SPOOLDIR_37
- Error message
SPOOLDIR_37("Batch size greater than maximum batch size allowed in sdc.properties, maxBatchSize: {}")
- Issue
-
The maximum batch size configured in the origin properties is greater than the Data Collector maximum batch size configured in the advanced engine configuration properties in the deployment.
- Troubleshooting and resolution
- To resolve the issue, modify the origin maximum batch size property so that it is less than the Data Collector production.maxBatchSize property.
TOERROR_00
- Error message
TOERROR_00("Sent to error by previous stage")
- Issue
-
The pipeline encountered an error while processing error records.
- Troubleshooting and resolution
- To resolve the issue, verify that the Error Records tab in the pipeline properties is correctly configured.