Window

The Window processor produces new batches of data from incoming batches based on the configured window type. Use the Window processor in streaming pipelines only. The processor is not supported in batch pipelines.

The Window processor creates windows of data and passes each window downstream as a batch. The processor can create the following types of windows: tumbling, sliding, session, and hopping.

You might use the Window processor in streaming pipelines to merge small batches into larger batches for more meaningful downstream processing.

For example, when using an Aggregate processor in a streaming pipeline, you might place the Window processor before the Aggregate processor to create larger batches for aggregate calculations. Similarly, when using a Join processor in a streaming pipeline, you might use the Window processor before the Join processor to enable joins on larger data sets.

When you configure the Window processor, you specify the window type to use and the properties for the window type.

When a window contains no data, the Window processor passes an empty batch downstream.