Low-Bit N-Gram Embeddings for Language Models
This research explores low-bit n-gram embedding tables to reduce the substantial memory requirements of open-weight language models.
This research explores low-bit n-gram embedding tables to reduce the substantial memory requirements of open-weight language models.