spdl.pipeline.defs.Aggregate

Aggregate(num_items: int, /, *, drop_last: bool = False) → PipeConfig[Any, Any][source]

Create a PipeConfig object for aggregation.

The aggregation buffers the incoming items and emits once enough items are buffered.

Parameters:

  • num_items – The number of items to buffer.

  • drop_last – Drop the last aggregation if it has less than num_aggregate items.

Returns:

The config object.

See also

Example: Pipeline definitions

Illustrates how to build a complex pipeline.