Janas: Run LLMs Larger Than RAM by Streaming Experts from SSD
Janas is a tool designed to run large language models exceeding RAM capacity by streaming experts from an SSD.
Janas is a tool designed to run large language models exceeding RAM capacity by streaming experts from an SSD.