altsfor

LiteLLM alternatives

14 apps like LiteLLM, sorted by how similar they are and by upvotes. About LiteLLM

  1. 1
    Cloudflare AI Gateway

    Proxy for AI APIs with caching, rate limiting, and analytics.

  2. 2
    Ollama

    Run open-source language models locally, with optional cloud for larger ones

  3. 3
    LocalAI

    Self-hosted, OpenAI-compatible API for LLMs, speech, images, and agents

  4. 4
    DataRobot

    Platform for building, deploying, and managing machine learning models.

  5. 5
    MindsDB

    Open-source platform for building AI models inside databases.

  6. 6
    Pinecone

    Managed vector database for AI applications and semantic search.

  7. 7
    Weaviate

    Open-source vector database with hybrid search and AI modules.

  8. 8
    Qdrant

    Open-source vector search engine and database for AI applications.

  9. 9
    Milvus

    Open-source vector database built for scalable similarity search.

  10. 10
    Chroma

    Open-source embedding database for building AI applications.

  11. 11
    OpenRouter

    Unified API for accessing many LLM providers and models.

  12. 12
    Portkey

    AI gateway with routing, caching, and observability for LLM apps.

  13. 13
    Helicone

    LLM observability and gateway platform for monitoring AI applications.

  14. 14
    ZenML

    Open-source framework for Python ML and AI pipelines with artifact lineage

Browse similar categories

Comments