Required Fields

A required field is a field that must exist in a record to allow it into the stage for processing. When a record does not include all required fields, it is processed based on the error handling configured for the pipeline. You can define required fields for any processor, executor, and most destination stages.

Configure required fields as part of the overall pipeline logic or to minimize processing errors. For example, if a Field Hasher processor encodes social security data in the SSN field. To ensure all records include social security numbers, you can make SSN a required field for the stage.