fairseq2.recipes.lm

Overview

The fairseq2.recipes.lm module provides utilities and recipes for language model training and fine-tuning. This includes tools for both pre-training and instruction tuning of language models.

Key Features

  • Language model pre-training utilities

  • Instruction fine-tuning support

  • CLI setup for language model training

  • Common training recipes and configurations

Submodules

The instruction_finetune module provides specialized utilities for instruction-based fine-tuning of language models.

Usage Examples