altsfor

Sonar

Serve LLMs at Scale with Kobold & OpenAI APIs

FreeOpen source

About Sonar

Serve LLMs at Scale with Kobold & OpenAI APIs. A starred pick on FMHY (fmhy.net) under AI Chatbots › Self-Hosting Tools.

Top alternatives

All 6
  1. 1
    SillyTavern

    Desktop App / Themes

  2. 2
    LM Studio

    Desktop App / Self-Hosted Models Only

  3. 3
    TextGen

    Web UI / Self-Hosted Models Only

  4. 4
    Unsloth

    Desktop App / Self-Hosted

  5. 5
    llama.cpp

    Self-Hosted Transformer-Based LLMs

    FreeOpen sourceLocal LLM runners
See all Sonar alternatives

Comments

Sign in with Google to comment