Latent Compaction with Test-Time Training
Researchers present Latent Compaction to reduce memory usage in long-context key-value caches through test-time training.
Researchers present Latent Compaction to reduce memory usage in long-context key-value caches through test-time training.