Kafila: Serving Large Language Models on Trusted Commodity Machines
Kafila enables large language models to be served across a trusted set of heterogeneous consumer computers without using public open swarms.
Kafila enables large language models to be served across a trusted set of heterogeneous consumer computers without using public open swarms.