QLoRA: Fine-Tune 65B-Class Models on a Single GPU Without Pretending 4-Bit Is Free
Dettmers et al. combine 4-bit NormalFloat quantization, double quantization, and paged optimizers with LoRA so large models fit in consumer memory. What is exact, what is approximate, and where quality actually drops.
3 min read