Shortcuts

xFormers optimized operators

Memory-efficient attention

Available implementations

Attention biases

Partial Attention

Non-autograd implementations