CRUD Operation and CDC Header Attributes
The MapR DB CDC origin includes the CRUD operation type in the sdc.operation.type record header attribute.
If you use a CRUD-enabled destination in the pipeline such as
JDBC Producer or Elasticsearch, the destination can use the operation type when
writing to destination systems. When necessary, you can use an Expression
Evaluator or scripting processors to manipulate the value in the
sdc.operation.type header attribute. For an overview of Data Collector changed data
processing and a list of CRUD-enabled destinations, see Processing Changed Data.
The MapR DB CDC origin includes additional CDC information in other record header
attributes. The following table describes the record header attributes that the MapR DB
CDC origin generates:
| Record Header Attribute | Description |
|---|---|
| mapr.op.timestamp | The timestamp associated with the change. |
| mapr.server.timestamp | The server timestamp associated with the change. |
| partition | Partition where the data originated. |
| offset | Offset for the data. |
| sdc.operation.type | The CRUD operation type associated with the record. The
sdc.operation.type record header attribute can include the following
values:
|
| topic | Topic where the data originated. |