Llama.cpp with API + GUI
Llama.cpp with API + GUI. A starred pick on FMHY (fmhy.net) under AI Chatbots › Self-Hosting Tools.
Desktop App / Themes
Desktop App / Self-Hosted Models Only
Web UI / Self-Hosted Models Only
Desktop App / Self-Hosted
Self-Hosted Transformer-Based LLMs