World Wires · story 39488 · unverified · 1 source(s)

Janas: Run LLMs Larger Than RAM by Streaming Experts from SSD

Janas is a tool designed to run large language models exceeding RAM capacity by streaming experts from an SSD.

Open in the desk

Coverage

What this site indexes