spdl.pipeline.SharedMemoryRingBuffer

class SharedMemoryRingBuffer(capacity: int)

[Experimental] A single shared-memory ring buffer for cross-process payloads.

Construct it in the parent process and pass it to spdl.pipeline.iterate_in_subprocess() via the arena argument; ownership transfers to that call, which closes and unlinks it at teardown.

Added in version 0.5.0.

Parameters:

capacity – Size of the payload arena in bytes. Must be at least as large as the biggest single pipeline unit (the sum of the binaries offloaded from one item). Size it to the in-flight high-water mark, roughly (buffer_size + 2) * max_unit_bytes.

Methods

close()	Release this process's mapping of the segment.
open_reader()	Return the reader endpoint (call in the parent process).
open_writer()	Return the writer endpoint (call in the worker process).
unlink()	Remove the segment from the system (call once, by the owner).

Attributes

capacity	Size of the payload arena in bytes.
head	Absolute byte count published by the writer.
name	Name of the underlying shared-memory segment.
tail	Absolute byte count released by the reader.

property capacity: int

Size of the payload arena in bytes.

close() → None

Release this process’s mapping of the segment.

property head: int

Absolute byte count published by the writer.

property name: str

Name of the underlying shared-memory segment.

open_reader() → _RingReader

Return the reader endpoint (call in the parent process).

open_writer() → _RingWriter

Return the writer endpoint (call in the worker process).

property tail: int

Absolute byte count released by the reader.

unlink() → None

Remove the segment from the system (call once, by the owner).