list_files

fairseq2.data.list_files(pathname, pattern=None)[source]

List recursively all files under pathname that matches pattern.

Parameters:
  • pathname (PathLike) – The path to traverse.

  • pattern (Optional[StringLike]) – If non-empty, a pattern that follows the syntax of fnmatch.

Return type:

DataPipelineBuilder