Mitigating Catastrophic Forgetting With Subspace Tuning
Researchers examine subspace tuning to mitigate catastrophic forgetting when fine-tuning large language models on new skills.
Researchers examine subspace tuning to mitigate catastrophic forgetting when fine-tuning large language models on new skills.