spdl.pipeline.defs.AggregateConfig

class AggregateConfig(name: str, num_items: int, drop_last: bool = False, _type: _PipeType = _PipeType.Aggregate)[source]

Configuration for aggregation operation.

Buffers incoming items and emits once enough items are buffered.

Attributes

drop_last

Whether to drop the last aggregation if it has fewer than num_items.

name

Name of the aggregation stage.

num_items

Number of items to buffer before emitting.

drop_last: bool = False

Whether to drop the last aggregation if it has fewer than num_items.

name: str

Name of the aggregation stage.

num_items: int

Number of items to buffer before emitting.