Open source alternatives to LiteLLM
9 apps like LiteLLM, sorted by how similar they are and by upvotes. About LiteLLM
- 1Helicone
LLM observability and gateway platform for monitoring AI applications.
- 2Weaviate
Open-source vector database with hybrid search and AI modules.
- 3Ollama
Run open-source language models locally, with optional cloud for larger ones
- 4LocalAI
Self-hosted, OpenAI-compatible API for LLMs, speech, images, and agents
- 5Milvus
Open-source vector database built for scalable similarity search.
- 6Qdrant
Open-source vector search engine and database for AI applications.
- 7MindsDB
Open-source platform for building AI models inside databases.
- 8Chroma
Open-source embedding database for building AI applications.
- 9ZenML
Open-source framework for Python ML and AI pipelines with artifact lineage