Serve LLMs at Scale with Kobold & OpenAI APIs
Serve LLMs at Scale with Kobold & OpenAI APIs. A starred pick on FMHY (fmhy.net) under AI Chatbots › Self-Hosting Tools.
Desktop App / Themes
Desktop App / Self-Hosted Models Only
Web UI / Self-Hosted Models Only
Desktop App / Self-Hosted
Self-Hosted Transformer-Based LLMs