Resetting the Kinesis Consumer Origin

You can reset the Kinesis Consumer origin to process all available data instead of continuing from the last-saved offset. For general information about resetting the origin, see Resetting the OriginResetting the Origin in the Data Collector documentationResetting the Origin for Jobs.

When you reset the origin for a Kinesis Consumer , Data Collector resets the origin for every Kinesis Consumer that uses the same application name.

Note the following requirement and guidelines before resetting the origin:
Requirement: Delete table permission on DynamoDB
Because Kinesis Streams stores offsets in DynamoDB, the IAM user or instance profile associated with the must have delete table permissions for tables matching the application name used in your , as follows:
  • If you use access keys to authenticate with Amazon Web Services, the IAM user associated with the access keys must have delete table permission.
  • If Data Collector uses instance profiles to authenticate, the instance profile for the EC2 instance must have delete permission.
Guidelines for resetting the origin
To reset the origin for a Kinesis Consumer , perform the following steps:
  1. Stop the that you want to reset.

    If other use the same application name, stop all of the .

  2. Reset the origin: In the canvas or from the Home page, click the More icon , then click Reset Origin.

    When working with multiple that use the same application name, you can use any of the . You only need to reset one of them.

  3. Start the with the reset origin.
  4. If you stopped any related , restart those .

For example, say you have three that read from Kinesis Streams using the Sales application name: NorthSales, CentralSales, and SouthSales. To reset the origin for all , stop all three , reset the origin for one of the , say SouthSales. Then restart the SouthSales , and then you can restart the other .