fairseq2 Reference
DataPipeline
DataPipelineBuilder
list_files()
read_sequence()
read_zipped_records()
read_text()
FileMapper
Collater
CollateOptionsOverride
AssetStore
AssetCard
AssetMetadataProvider
Misc
Bases: ABC
ABC
Provides asset metadata.
Clear any cached asset metadata.
Return the metadata of the specified asset.
name (str) – The name of the asset.
Dict[str, Any]
Return the names of the assets for which this provider has metadata.
List[str]