Reference C++ inference engine for open-source LLMs. Foundational layer beneath Ollama, LM Studio, Jan, KoboldCpp.
No community reviews yet. Be the first below.
Honest, brand-neutral feedback welcome. A curator approves before it appears here. No JS required.