spdl.source¶
Overview¶
Iterables for traversing datasets and utilities for transforming them.
API Reference¶
Classes
IterableWithShuffle¶
A protocol that is often used to represent data source. |
SizedIterable¶
A protocol that is often used to represent data source. |
SizedIterableWithShuffle¶
A protocol that is often used to represent data source. |
DistributedRandomSampler¶
Sample dataset indices for the given distributed node while applying randomness. |
DistributedDeterministicSampler¶
Sampler for distributed training that splits indices across multiple ranks. |
Modules
imagenet¶
Iterable for ImageNet dataset. |
local_directory¶
Iterable for traversing local file directory. |
utils¶
Implements meta-transformations on iterables/iterators. |