llm-gateway
by openziti · github.com/openziti/llm-gateway
Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual API keys, and end-to-end encryption via OpenZiti
Stars
★ 80
Forks
5
Language
Go
Category
LLM Tools
License
Apache-2.0
agentic-aiai-gatewayai-infrastructureai-securityanthropice2e-encryptionllm-gatewayllm-proxyllm-securityload-balancingnon-human-identityollamagoopenaillm
Featured in
- llm-gateway @ 14:13 · Mar 30, 2026