DeepInferLocal LLMs & InferenceDeepInfer is an Apache-licensed DeepSeek inference engine for Linux, NVIDIA SM100 GPUs and Huawei Ascend 950 NPUs, supporting offline inference.Open sourceSelf-hostedViews · 7 daysTemporarily unavailable
Directory topic
LLM Inference
Explore tools connected to this topic.
4 results in LLM Inference
Active Pro listings from this category appear first. Your sort applies within Pro and Free results.
DeepInferLocal LLMs & InferenceDeepInfer is an Apache-licensed DeepSeek inference engine for Linux, NVIDIA SM100 GPUs and Huawei Ascend 950 NPUs, supporting offline inference.Open sourceSelf-hosted6 views25,550 stars
OllamaLocal LLMs & InferenceOllama is an MIT-licensed tool for downloading and running open models such as Gemma, Qwen, DeepSeek and gpt-oss on your own machine. It ships a desktop app, CLI and local REST API, and offers cloud-hosted models on a pay-as-you-go or subscription basis.Open sourceSelf-hostedFreemiumViews · 7 daysTemporarily unavailable
StrataLocal LLMs & InferenceOpen-source local LLM engine with a desktop app and terminal app for Windows, Linux and Mac. It splits mixture-of-experts models across GPU, RAM and SSD and serves OpenAI- and Anthropic-compatible APIs to coding tools.Open sourceSelf-hostedViews · 7 daysTemporarily unavailable
XolotlLocal LLMs & InferenceXolotl is an MIT-licensed local inference engine built from Strata that serves DeepSeek-V4.1-Flash, GLM-5.3-Flash, Qwen3.8 and LFM3-Omni over OpenAI- and Anthropic-compatible APIs, tiering MoE experts across VRAM, pinned RAM and NVMe.Open sourceSelf-hostedViews · 7 daysTemporarily unavailable
0 tools selectedCompare selected