spdl.pipeline.defs.PipelineConfig¶

class PipelineConfig(src: SourceConfig[T], pipes: Sequence[PipeConfig[Any, Any]], sink: SinkConfig[U])[source]¶

A pipeline configuration.

A pipeline consists of source, a series of pipes and sink.

You can use spdl.pipeline.build_pipeline() to build a spdl.pipeline.Pipeline object.

Attributes

`src`	Source configuration.
`pipes`	Pipe configurations.
`sink`	Sink configuration.

pipes: Sequence[PipeConfig[Any, Any]]¶: Pipe configurations.

sink: SinkConfig[U]¶: Sink configuration.

src: SourceConfig[T]¶: Source configuration.