Home › LLM Tools › orthrus

orthrus

by chiennv2000 · github.com/chiennv2000/orthrus

Fast, lossless LLM inference via dual-view diffusion decoding.

Stars
★ 460
Forks
20
Language
Python
Category
LLM Tools
License
MIT
diffusion-language-modelsefficient-inferencelarge-language-modelsllmllm-efficiencymodel-architecturenatural-language-processingpython

View on GitHub ↗

Featured in