shard
by leyten · github.com/leyten/shard
Pipeline-parallel LLM inference across GPUs on separate machines.
Stars
★ 433
Forks
57
Language
Python
Category
LLM Tools
License
Apache-2.0
pythonllm
Featured in
- shard @ 07:48 · Jun 22, 2026