==================
fairseq2.data.text
==================

.. module:: fairseq2.data.text

This module contains text tokenizers and text specific data pipeline operators.

.. autoclasstree:: fairseq2.data.text
   :full:
   :zoom:

.. toctree::
    :maxdepth: 1

    text_tokenizers