Field Merger
The Field Merger merges one or more fields in a record to a different location in the record. Use only for records with a list or map structure.
- New target field
- When you define a new field, the Field Merger creates the new field and merges the selected fields under the new field.
- Existing target field
- When you choose an existing field as the target field, the Field Merger merges the selected fields under the target field. You can optionally overwrite target fields of the same name if they already exist.
Configuring a Field Merger Processor
Configure a Field Merger to merge or move fields within a list or map record.
-
In the Properties panel, on the General tab, configure the
following properties:
General Property Description Name Stage name. Description Optional description. Required Fields Fields that must include data for the record to be passed into the stage. Tip: You might include fields that the stage uses.Records that do not include all required fields are processed based on the error handling configured for the pipeline.
Preconditions Conditions that must evaluate to TRUE to allow a record to enter the stage for processing. Click Add to create additional preconditions. Records that do not meet all preconditions are processed based on the error handling configured for the stage.
On Record Error Error record handling for the stage: - Discard - Discards the record.
- Send to Error - Sends the record to the pipeline for error handling.
- Stop Pipeline - Stops the pipeline. Not valid for cluster pipelines.
-
On the Merge tab, configure the following
properties:
Field Merger Properties Description Source Field Does Not Exist Action to take if the source field does not exist in a record: - Continue - Passes nulls for the missing values.
- Send to Error - Passes the record to the pipeline for error handling.
Overwrite Fields Overwrites any existing fields in the target field with names that match the merge fields. Fields to Merge One or more fields to merge. Select the existing fields that you want to merge and the corresponding target fields. For the target fields, use an existing field or enter a field name to be created before the merge.