Development Notes

• Implementation detail of Pipeline
  • Async IO
  • Queue vs Async Queue as Buffer
  • Thread, loop and task
• Remote Iterable Protocol
  • Worker State
  • Helper functions and data structures
    • _Cmd
      • _Cmd.ABORT
      • _Cmd.START_ITERATION
      • _Cmd.STOP_ITERATION
    • _Status
      • _Status.INITIALIZATION_FAILED
      • _Status.INITIALIZATION_SUCCEEDED
      • _Status.ITERATION_FINISHED
      • _Status.ITERATION_STARTED
      • _Status.ITERATOR_FAILED
      • _Status.ITERATOR_SUCCESS
      • _Status.UNEXPECTED_CMD_RECEIVED
    • _enter_iteration_mode()
    • _execute_iterable()
    • _drain()
    • _iterate_results()
    • _SubprocessIterable
      • _SubprocessIterable.__iter__()
• PyTorch CUDA Race Condition in Multi-threading
  • Background
  • The Problem
  • The Solution: Caching the reference in transfer_tensor
  • References