spdl.pipeline.defs.MergeConfig

class MergeConfig[source]

Merge multiple pipelines into one output queue. Use Merge() to create a config.

See also

Example: Pipeline definitions

Illustrates how to build a complex pipeline.

Attributes

op

Optional custom merge operation.

pipeline_configs

The pipeline configurations to merge.

op: Callable[[str, Sequence[Queue], Queue], Awaitable[None]] | None = None

Optional custom merge operation.

If provided, this custom operation will be used to merge items from the input queues. The operation should be an async function with signature: (name: str, input_queues: Sequence[Queue], output_queue: Queue) -> None

If not provided, the default merge operation will be used, which passes items from all input queues to the output queue in the order they become available.

pipeline_configs: tuple[PipelineConfig[Any]]

The pipeline configurations to merge.