MongoDB Oplog

Supported pipeline types:

  • Data Collector
The MongoDB Oplog origin reads entries from MongoDB Oplog. For information about supported versions, see Supported Systems and VersionsSupported Systems and Versions in the Data Collector documentation.

MongoDB stores information about changes to the database in a local capped collection called an Oplog. The Oplog contains information about changes in data as well as changes in the database. The MongoDB Oplog origin can read any operation written to the Oplog.

Use the MongoDB Oplog origin to capture changes in data or the database. To process MongoDB data written to a standard capped or uncapped collection, use the MongoDB origin.

The MongoDB Oplog origin includes the CRUD operation type in a record header attribute so generated records can be easily processed by CRUD-enabled destinations. For an overview of Data Collector changed data processing and a list of CRUD-enabled destinations, see Processing Changed Data.

When you configure the MongoDB Oplog origin, you configure connection information, such as the connection string and MongoDB credentials. You can also use a connectionconnection to configure the origin. You define an optional timestamp and ordinal to specify where to start the read, the operations that you want to process, and the read preference.

You can optionally configure advanced options that determine how the origin connects to MongoDB, including enabling SSL/TLS.