- Primary focus
- Run open-weight LLMs locally, with a free local API
- Deployment
- Self-hosted
- Source model
- Open source
- Pricing model
- open source
- API available
- Yes
- Windows desktop
- Not specified
- Mobile app
- Not specified
- Overview
- Ollama is an open-source, MIT-licensed tool for running LLMs on your own hardware via a local REST API and CLI; local use is free and unlimited, with an optional paid Ollama Cloud for larger models.

| Attribute | |||
|---|---|---|---|
| Overview | |||
| Primary focus | Run open-weight LLMs locally, with a free local API | Managed platform for Ray, scaling AI/ML and Python workloads from a laptop to a cluster. | Free, open-source local and self-hosted LLM workspace |
| Deployment | Self-hosted | Self-hosted | Self-hosted |
| Source model | Open source | Other license | Open source |
| Pricing model | open source | paid | open source |
| API available | Yes | Yes | Yes |
| Windows desktop | Not specified | Not specified | Not specified |
| Mobile app | Not specified | Not specified | Not specified |
| Overview | Ollama is an open-source, MIT-licensed tool for running LLMs on your own hardware via a local REST API and CLI; local use is free and unlimited, with an optional paid Ollama Cloud for larger models. | Anyscale is the company behind Ray, the open-source distributed computing framework born at UC Berkeley's RISELab. Its managed platform runs training, batch inference, and LLM serving workloads on autoscaling Ray clusters, hosted or in your own cloud (BYOC). | AnythingLLM is a free, MIT-licensed desktop and self-hostable app (by Mintplex Labs) for chatting with your own documents locally, with a separate paid team/cloud option. |
| Explore further | |||
| Vendor website | Visit vendor ↗ | Visit vendor ↗ | Visit vendor ↗ |
| ITHub profile | View full profile → | View full profile → | View full profile → |
- Primary focus
- Managed platform for Ray, scaling AI/ML and Python workloads from a laptop to a cluster.
- Deployment
- Self-hosted
- Source model
- Other license
- Pricing model
- paid
- API available
- Yes
- Windows desktop
- Not specified
- Mobile app
- Not specified
- Overview
- Anyscale is the company behind Ray, the open-source distributed computing framework born at UC Berkeley's RISELab. Its managed platform runs training, batch inference, and LLM serving workloads on autoscaling Ray clusters, hosted or in your own cloud (BYOC).
- Primary focus
- Free, open-source local and self-hosted LLM workspace
- Deployment
- Self-hosted
- Source model
- Open source
- Pricing model
- open source
- API available
- Yes
- Windows desktop
- Not specified
- Mobile app
- Not specified
- Overview
- AnythingLLM is a free, MIT-licensed desktop and self-hostable app (by Mintplex Labs) for chatting with your own documents locally, with a separate paid team/cloud option.
ⓘ Confirm technical details and prices with each vendor before making a decision.