Kinesis Consumer

Supported pipeline types:

  • Data Collector
The Kinesis Consumer origin reads data from Amazon Kinesis Streams. For information about supported versions, see Supported Systems and VersionsSupported Systems and Versions in the Data Collector documentation.

When you configure Kinesis Consumer, you specify the Amazon Web Services connection information for your Kinesis cluster and the data format of source data. You can also configure additional Kinesis configuration properties that you require.

The Kinesis Consumer origin can use multiple threads to enable parallel processing of data from the cluster.

The Kinesis Consumer origin stores offsets in DynamoDB lease tables. You can optionally define tags to apply to a lease table created by the origin. When necessary, you can reset the origin for Kinesis Consumer pipelines, but be sure to review the requirements and guidelines before doing so.

You can also use a connectionconnection to configure the origin.