Questioning Instrumental Convergence in RLVR: Evidence from OLMo-3
Using checkpoints from OLMo-3, the study investigates whether reinforcement learning causes language models to acquire power-seeking subgoals.
Using checkpoints from OLMo-3, the study investigates whether reinforcement learning causes language models to acquire power-seeking subgoals.