Internal Attributes
Data Collector generates and updates some read-only internal record header attributes as records move from stage to stage. These attributes can be viewed for debugging issues, but can only be updated by Data Collector.
The record:attribute function does not allow access to internal record header attributes.
The following table describes the internal record header attributes and the functions
that you can use to access the data in the pipeline:
| Internal Record Header Attribute | Description | Related Function |
|---|---|---|
| stageCreator | The ID of the stage that created the record. | record:creator() |
| sourceId | Source of the record. Can include different information based on the origin type. | record:id() |
| stagesPath | List of stages that processed the record in order, by stage name. | record:path() |
| trackingId | The route the record has taken through the pipeline, starting with the sourceId, then listing the stages that processed the record. | n/a |
| previousTrackingId | The tracking ID of the record before it entered the current stage. | n/a |
| errorStage | The stage that generated the error. In error records only. |
record:errorStage() |
| errorStageLabel | The user-defined name for a stage. In error records only. |
record:errorStageLabel() |
| errorCode | The error code. In error records only. |
record:errorCode() |
| errorJobId | The ID of the job that started the pipeline. Only in error records from pipelines started by Control Hub jobs. |
n/a |
| errorMessage | The error message. In error records only. |
record:errorMessage() |
| errorTimestamp | The time that the error occurred. In error records only. |
record:errorTime() |
| errorStackTrace | The stack trace associated with the error. In error records only. |
n/a |