Transformers with CoT Discover Heavy-Ball Acceleration
Researchers analyze how transformers utilizing chain-of-thought reasoning can learn to implement gradient descent and discover heavy-ball acceleration duri
Researchers analyze how transformers utilizing chain-of-thought reasoning can learn to implement gradient descent and discover heavy-ball acceleration duri