spdl.pipeline¶

Overview¶

Implements Pipeline, a generic task execution engine.

API Reference¶

Functions

create_task¶

Wrapper around asyncio.create_task().

Classes

Pipeline¶

Data processing pipeline.

PipelineBuilder¶

PipelineBuilder

Build Pipeline object.

PipelineHook¶

Base class for hooks to be used in the pipeline.

TaskStatsHook¶

TaskStatsHook

Track the task runtimes and success rate.

Exceptions

PipelineFailure¶

PipelineFailure

Thrown by spdl.pipeline.Pipeline when pipeline encounters an error.