World Wires · story 104073 · corroborated · 1 source(s)

LoopVQ: Sub 1-bit KV Cache Quantization for Looped Transformers

LoopVQ introduces sub 1-bit key-value cache quantization for looped transformers to reduce parameter memory in language modeling.

Open in the desk

Coverage

What this site indexes