waste
by sqliteai · github.com/sqliteai/waste
Run the full 2.78-trillion-parameter Kimi K3 model beyond available RAM by streaming activated weights directly from NVMe. A dependency-free, embeddable C inference engine.
Stars
★ 1.5k
Forks
110
Language
C
Category
Dev Tools
License
Apache-2.0
c
Featured in
- waste @ 04:34 · Aug 3, 2026