Pulsar Consumer

The Pulsar Consumer origin subscribes to Pulsar topics, processes incoming messages, and then sends acknowledgements back to Pulsar as the messages are read.

When you configure a Pulsar Consumer origin, you define the URL to connect to Pulsar. You also define the subscription name and consumer name to use for the origin and the topics to subscribe to. When the pipeline starts, Pulsar creates a consumer with the specified consumer name. If the subscription and topics do not exist, Pulsar also creates the subscription and topics.

You can configure the origin to use Pulsar security features. You can also configure advanced properties as needed, such as the type of subscription to create or the initial offset to begin reading from.

The Pulsar Consumer origin can include record header attributes that enable you to use information about the record in pipeline processing.

For more information about Pulsar topics, subscriptions, and consumers, see the Apache Pulsar documentation.