Open source alternatives to Ollama
8 apps like Ollama, ranked by how much they overlap and by votes. About Ollama
- 1LocalAI
Self-hosted, OpenAI-compatible API for LLMs, speech, images, and agents
- 2Jan
Run open-source AI models on your own hardware, or connect to cloud providers
- 3Mastra
TypeScript framework for building AI agents, workflows, and RAG pipelines
- 4ZenML
Open-source framework for Python ML and AI pipelines with artifact lineage
- 5LibreChat
Self-hostable chat UI for many AI providers with agents and multi-user access
- 6Open WebUI
Self-hosted AI chat platform for local and cloud models
- 7Eve
Vercel's filesystem-first TypeScript framework for durable AI agents
- 8Flue
Programmable coding-agent harness in TypeScript for Node or Cloudflare Workers