DCKV: Learned Transform Coding of the Prompt KV Cache
Introduces DCKV, an end-to-end trained differentiable codec for prompt key-value caches in hybrid language models.
Introduces DCKV, an end-to-end trained differentiable codec for prompt key-value caches in hybrid language models.