QRAE: Query-Relevant Attention Entropy for Context Compression
Researchers propose QRAE, an online context compression method using sparse evidence-assessment heads to reduce token consumption and latency in DeepSearch
Researchers propose QRAE, an online context compression method using sparse evidence-assessment heads to reduce token consumption and latency in DeepSearch