fairseq2.recipes.lm¶
Overview¶
The fairseq2.recipes.lm
module provides utilities and recipes for language model training and fine-tuning.
This includes tools for both pre-training and instruction tuning of language models.
Key Features¶
Language model pre-training utilities
Instruction fine-tuning support
CLI setup for language model training
Common training recipes and configurations
Submodules¶
The instruction_finetune
module provides specialized utilities for instruction-based fine-tuning of language models.