Sort

The Sort processor sorts incoming data based on one or more specified fields. The processor can sort data in ascending or descending order.

For example, let's say that you create a batch pipeline to read all available data in the orders table in a relational database, transform the data, and then write the data to a destination system. Before writing the data, you want the pipeline to sort all records by the order ID. To do this, you add a Sort processor before the destination, and configure the processor to sort by the order_id field in ascending order.