spdl.dataloader

Utilities to run I/O operations efficiently.

Functions

create_task

Classes

Pipeline

Pipeline

Data processing pipeline.

PipelineBuilder

PipelineBuilder

Build Pipeline object.

PipelineHook

PipelineHook

Base class for hooks to be used in the pipeline.

TaskStatsHook

TaskStatsHook

Track the task runtimes and success rate.

Exceptions

PipelineFailure

PipelineFailure

Thrown by spdl.dataloader.Pipeline when pipeline encounters an error.