Knowingly Wrong: Training LLMs Against Beliefs Induces Misalignment
Fine-tuning language models on data they believe to be false can induce broad behavioral misalignment even without containing explicitly harmful content.
Fine-tuning language models on data they believe to be false can induce broad behavioral misalignment even without containing explicitly harmful content.