Redesigning 4-bit AdamW Optimizer-State Quantization
Researchers redesigned 4-bit optimizer-state quantization for AdamW from the perspective of rounding space to prevent error propagation in moment recurrenc
Researchers redesigned 4-bit optimizer-state quantization for AdamW from the perspective of rounding space to prevent error propagation in moment recurrenc