Freemium alternatives to LiteLLM
12 apps like LiteLLM, sorted by how similar they are and by upvotes. About LiteLLM
- 1Cloudflare AI Gateway
Proxy for AI APIs with caching, rate limiting, and analytics.
- 2OpenRouter
Unified API for accessing many LLM providers and models.
- 3Weaviate
Open-source vector database with hybrid search and AI modules.
- 4Ollama
Run open-source language models locally, with optional cloud for larger ones
- 5Milvus
Open-source vector database built for scalable similarity search.
- 6Pinecone
Managed vector database for AI applications and semantic search.
- 7Qdrant
Open-source vector search engine and database for AI applications.
- 8MindsDB
Open-source platform for building AI models inside databases.
- 9Chroma
Open-source embedding database for building AI applications.
- 10Portkey
AI gateway with routing, caching, and observability for LLM apps.
- 11Helicone
LLM observability and gateway platform for monitoring AI applications.
- 12ZenML
Open-source framework for Python ML and AI pipelines with artifact lineage