Open source alternatives to DeepInfra
16 apps like DeepInfra, sorted by how similar they are and by upvotes. About DeepInfra
- 1LocalAI
Self-hosted, OpenAI-compatible API for LLMs, speech, images, and agents
- 2Ollama
Run open-source language models locally, with optional cloud for larger ones
- 3Mastra
TypeScript framework for building AI agents, workflows, and RAG pipelines
- 4LiteLLM
Open-source proxy that gives one API for many LLM providers.
- 5Weaviate
Open-source vector database with hybrid search and AI modules.
- 6Milvus
Open-source vector database built for scalable similarity search.
- 7Qdrant
Open-source vector search engine and database for AI applications.
- 8MindsDB
Open-source platform for building AI models inside databases.
- 9Chroma
Open-source embedding database for building AI applications.
- 10Flue
Programmable coding-agent harness in TypeScript for Node or Cloudflare Workers
- 11ZenML
Open-source framework for Python ML and AI pipelines with artifact lineage
- 12Jan
Run open-source AI models on your own hardware, or connect to cloud providers
- 13Eve
Vercel's filesystem-first TypeScript framework for durable AI agents
- 14Open WebUI
Self-hosted AI chat platform for local and cloud models
- 15LibreChat
Self-hostable chat UI for many AI providers with agents and multi-user access
- 16