- Primary focus
- Free, open-source local and self-hosted LLM workspace
- Deployment
- Self-hosted
- Source model
- Open source
- Pricing model
- open source
- API available
- Yes
- Windows desktop
- Not specified
- Mobile app
- Not specified
- Overview
- AnythingLLM is a free, MIT-licensed desktop and self-hostable app (by Mintplex Labs) for chatting with your own documents locally, with a separate paid team/cloud option.

| Attribute | |||
|---|---|---|---|
| Overview | |||
| Primary focus | Free, open-source local and self-hosted LLM workspace | Managed platform for Ray, scaling AI/ML and Python workloads from a laptop to a cluster. | Enterprise language models via API, plus North and Compass |
| Deployment | Self-hosted | Self-hosted | Self-hosted |
| Source model | Open source | Other license | Other license |
| Pricing model | open source | paid | freemium |
| API available | Yes | Yes | Yes |
| Windows desktop | Not specified | Not specified | Not specified |
| Mobile app | Not specified | Not specified | Not specified |
| Overview | AnythingLLM is a free, MIT-licensed desktop and self-hostable app (by Mintplex Labs) for chatting with your own documents locally, with a separate paid team/cloud option. | Anyscale is the company behind Ray, the open-source distributed computing framework born at UC Berkeley's RISELab. Its managed platform runs training, batch inference, and LLM serving workloads on autoscaling Ray clusters, hosted or in your own cloud (BYOC). | Cohere provides text generation, embedding and rerank models via API for enterprise use, alongside North (an AI workplace platform) and Compass (enterprise search), with free trial keys and usage-based production pricing. |
| Explore further | |||
| Vendor website | Visit vendor ↗ | Visit vendor ↗ | Visit vendor ↗ |
| ITHub profile | View full profile → | View full profile → | View full profile → |
- Primary focus
- Managed platform for Ray, scaling AI/ML and Python workloads from a laptop to a cluster.
- Deployment
- Self-hosted
- Source model
- Other license
- Pricing model
- paid
- API available
- Yes
- Windows desktop
- Not specified
- Mobile app
- Not specified
- Overview
- Anyscale is the company behind Ray, the open-source distributed computing framework born at UC Berkeley's RISELab. Its managed platform runs training, batch inference, and LLM serving workloads on autoscaling Ray clusters, hosted or in your own cloud (BYOC).
- Primary focus
- Enterprise language models via API, plus North and Compass
- Deployment
- Self-hosted
- Source model
- Other license
- Pricing model
- freemium
- API available
- Yes
- Windows desktop
- Not specified
- Mobile app
- Not specified
- Overview
- Cohere provides text generation, embedding and rerank models via API for enterprise use, alongside North (an AI workplace platform) and Compass (enterprise search), with free trial keys and usage-based production pricing.
ⓘ Confirm technical details and prices with each vendor before making a decision.