Contents Menu Expand Light mode Dark mode Auto light/dark, in light mode Auto light/dark, in dark mode Skip to content
SPDL 0.0.6 documentation
SPDL 0.0.6 documentation
  • Home

Contents

  • Overview
  • Installation
  • Getting Started
    • Building and Running Pipeline
    • Pipeline Stages
    • Concurrency
  • Performance Analysis
    • Is data loading bottleneck?
    • Which stage is the bottleneck?
  • Usage Guide
    • Why try SPDL?
    • Paradigm Shift
    • Practical Example
  • Best Practices
  • Examples
    • image_dataloading
    • video_dataloading
    • imagenet_classification
    • multi_thread_preprocessing
  • Frequently Asked Questions

API References

  • API Reference
    • spdl.io
    • spdl.pipeline
    • spdl.dataloader
    • spdl.utils
  • API Reference (C++)
    • Class List
    • File List
    • API
      • Namespace spdl
      • Namespace spdl::core
      • Namespace std
      • Struct Buffer
      • Struct BytesAdaptor
      • Struct CPUBuffer
      • Struct CropArea
      • Struct CUDABuffer
      • Struct CUDAConfig
      • Struct DataInterface
      • Struct DecodeConfig
      • Struct DemuxConfig
      • Struct EncodeConfig
      • Struct Rational
      • Struct SourceAdaptor
      • Struct Storage
      • Class CPUStorage
      • Class CUDAStorage
      • Template Class DemuxedPackets
      • Class Demuxer
      • Template Class FFmpegFrames
      • Class InternalError
      • Class TracingSession
      • Enum ElemClass
      • Enum MediaType
      • Function spdl::core::apply_bsf
      • Template Function spdl::core::clone(const DemuxedPackets<media_type>&)
      • Template Function spdl::core::clone(const FFmpegFrames<media_type>&)
      • Template Function spdl::core::convert_frames(const std::vector<const FFmpegFrames<media_type> *>&, std::shared_ptr<CPUStorage>)
      • Template Function spdl::core::convert_frames(const FFmpegFrames<media_type> *, std::shared_ptr<CPUStorage>)
      • Function spdl::core::cp_to_cpu
      • Function spdl::core::cpu_buffer
      • Function spdl::core::decode_image_nvjpeg(const std::string_view&, const CUDAConfig&, int, int, const std::string&)
      • Function spdl::core::decode_image_nvjpeg(const std::vector<std::string_view>&, const CUDAConfig&, int, int, const std::string&)
      • Template Function spdl::core::decode_packets_ffmpeg
      • Template Function spdl::core::decode_packets_nvdec(PacketsPtr<media_type>, const CUDAConfig&, const CropArea&, int, int, const std::optional<std::string>&)
      • Function spdl::core::decode_packets_nvdec(std::vector<ImagePacketsPtr>&&, const CUDAConfig&, const CropArea&, int, int, const std::optional<std::string>&, bool)
      • Function spdl::core::encode_image
      • Function spdl::core::extract_packets_at_indices
      • Function spdl::core::get_ffmpeg_filters
      • Function spdl::core::get_ffmpeg_log_level
      • Function spdl::core::init_glog
      • Function spdl::core::init_tracing
      • Function spdl::core::is_cuda_available
      • Function spdl::core::is_nvcodec_available
      • Template Function spdl::core::make_decoder
      • Function spdl::core::make_demuxer(const std::string&, const SourceAdaptorPtr&, const std::optional<DemuxConfig>&)
      • Function spdl::core::make_demuxer(const std::string_view, const std::optional<DemuxConfig>&)
      • Function spdl::core::register_avdevices
      • Template Function spdl::core::requires
      • Function spdl::core::set_ffmpeg_log_level
      • Template Function spdl::core::trace_counter
      • Function spdl::core::trace_event_begin
      • Function spdl::core::trace_event_end
      • Function spdl::core::transfer_buffer(CPUBufferPtr, const CUDAConfig&)
      • Function spdl::core::transfer_buffer(const std::vector<size_t>&, ElemClass, size_t, void *, const CUDAConfig&)
      • Function spdl::core::transfer_buffer(const std::vector<size_t>&, ElemClass, size_t, const void *)
      • Define _IS_AUDIO
      • Define _IS_IMAGE
      • Define _IS_VIDEO
      • Define SPDL_DEFAULT_BUFFER_SIZE
      • Typedef spdl::core::AudioPackets
      • Typedef spdl::core::AudioPacketsPtr
      • Typedef spdl::core::CPUBufferPtr
      • Typedef spdl::core::cuda_allocator
      • Typedef spdl::core::cuda_allocator_fn
      • Typedef spdl::core::cuda_deleter_fn
      • Typedef spdl::core::CUDABufferPtr
      • Typedef spdl::core::DecoderPtr
      • Typedef spdl::core::DemuxerPtr
      • Typedef spdl::core::FFmpegAudioFrames
      • Typedef spdl::core::FFmpegAudioFramesPtr
      • Typedef spdl::core::FFmpegFramesPtr
      • Typedef spdl::core::FFmpegImageFrames
      • Typedef spdl::core::FFmpegImageFramesPtr
      • Typedef spdl::core::FFmpegVideoFrames
      • Typedef spdl::core::FFmpegVideoFramesPtr
      • Typedef spdl::core::ImagePackets
      • Typedef spdl::core::ImagePacketsPtr
      • Typedef spdl::core::OptionDict
      • Typedef spdl::core::PacketsPtr
      • Typedef spdl::core::SourceAdaptorPtr
      • Typedef spdl::core::VideoPackets
      • Typedef spdl::core::VideoPacketsPtr
  • API Index

Development Notes

  • Development Notes
    • Implementation detail of Pipeline
Back to top
View this page

Development NotesΒΆ

  • Implementation detail of Pipeline
    • Async IO
    • Queue vs Async Queue as Buffer
    • Thread, loop and task
Next
Implementation detail of Pipeline
Copyright © 2024, Meta Platforms, Inc.
Made with Sphinx and @pradyunsg's Furo