altsfor

llama.cpp

Self-Hosted Transformer-Based LLMs

FreeOpen source

About llama.cpp

Self-Hosted Transformer-Based LLMs. A starred pick on FMHY (fmhy.net) under AI Chatbots › Self-Hosting Tools.

Top alternatives

All 6
  1. 1
    SillyTavern

    Desktop App / Themes

  2. 2
    LM Studio

    Desktop App / Self-Hosted Models Only

  3. 3
    TextGen

    Web UI / Self-Hosted Models Only

  4. 4
    Unsloth

    Desktop App / Self-Hosted

  5. 5
    KoboldCpp

    Llama.cpp with API + GUI

    FreeOpen sourceLocal LLM runners
See all llama.cpp alternatives

Comments

Sign in with Google to comment