LiteLLM alternatives for Self-hosted
8 apps like LiteLLM, sorted by how similar they are and by upvotes. About LiteLLM
- 1Helicone
LLM observability and gateway platform for monitoring AI applications.
- 2Weaviate
Open-source vector database with hybrid search and AI modules.
- 3LocalAI
Self-hosted, OpenAI-compatible API for LLMs, speech, images, and agents
- 4Milvus
Open-source vector database built for scalable similarity search.
- 5Qdrant
Open-source vector search engine and database for AI applications.
- 6MindsDB
Open-source platform for building AI models inside databases.
- 7Chroma
Open-source embedding database for building AI applications.
- 8ZenML
Open-source framework for Python ML and AI pipelines with artifact lineage