spdl.pipeline.run_pipeline_in_subprocess

run_pipeline_in_subprocess(
builder: PipelineBuilder[T, U],
*,
num_threads: int,
**kwargs: dict[str, Any]
) → Iterator[T]

Run the given Pipeline in a subprocess, and iterate on the result.

Parameters:

• builder – The definition of Pipeline.

• num_threads – Passed to PipelineBuilder.build().

• kwargs – Passed to iterate_in_subprocess().

Yields:

The results yielded from the pipeline.