ZFO: Zero-and-First-Order Methods for LLM Fine-Tuning
ZFO decouples direction selection from step-size in neural network optimization by combining zero- and first-order methods.
ZFO decouples direction selection from step-size in neural network optimization by combining zero- and first-order methods.