DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm
☆21,528Aug 9, 2026Updated last week
Alternatives and similar repositories for ds4
Users that are interested in ds4 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI☆93,128Updated this week
- Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦☆25,406Updated this week
- LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar☆19,392Updated this week
- The agent that grows with you☆232,420Updated this week
- LLM inference in C/C++☆124,507Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The open source coding agent.☆198,745Updated this week
- AI agents running research on single-GPU nanochat training automatically☆94,072Mar 26, 2026Updated 4 months ago
- Run frontier AI locally.☆46,872Jun 23, 2026Updated last month
- Local UI to run and train LLMs and diffusion models, including Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, DeepSeek-V4, FLUX and more.☆73,589Updated this week
- an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM☆52,955Updated this week
- Lightweight coding agent that runs in your terminal☆106,653Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆89,360Updated this week
- MLX: An array framework for Apple silicon☆28,030Updated this week
- A tool for creating and running Linux containers using lightweight virtual machines on a Mac. It is written in Swift, and optimized for A…☆49,044Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ⌥ AI Coding agent for the terminal — hash-anchored edits, optimized tool harness, LSP, Python, browser, subagents, and more☆25,624Updated this week
- Open-source, community-driven agent harness☆40,828Updated this week
- The best ChatGPT that $100 can buy.☆57,290Aug 2, 2026Updated 2 weeks ago
- Skills for Real Engineers. Straight from my .agents directory.☆221,490Updated this week
- Scale computer-use 2.0 with open-source drivers, cross-OS fleets, and benchmarks for training, evaluation, and data generation.☆21,468Updated this week
- An agentic skills framework & software development methodology that works.☆273,538Updated this week
- Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞☆386,648Updated this week
- DFlash: Block Diffusion for Flash Speculative Decoding☆5,643May 10, 2026Updated 3 months ago
- The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails…☆56,656Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A lightweight alternative to OpenClaw that runs in containers for security. Connects to WhatsApp, Telegram, Slack, Discord, Gmail and oth…☆30,542Updated this week
- Python tool for converting files and office documents to Markdown.☆174,442Jul 29, 2026Updated 2 weeks ago
- DeepSpec: a full-stack codebase for training and evaluating speculative decoding algorithms☆6,993Jul 9, 2026Updated last month
- Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for…☆66,763Updated this week
- Symphony turns project work into isolated, autonomous implementation runs, allowing teams to manage work instead of supervising coding ag…☆26,737Updated this week
- Run deepseek4 locally on metal right from within Pi☆167Aug 7, 2026Updated last week
- 3x faster speeds on MLX | Qwen 3.8 27B | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.☆1,384Updated this week
- Warp is an agentic development environment, born out of the terminal.☆64,312Updated this week
- Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.☆178,873Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- LLM speculative inference server for consumer & heterogeneous hardware☆2,762Updated this week
- 🎨 Best DeepSeek Harness Design Plugin. The open-source Claude Design alternative. 🖥️ Local-first desktop app. 🖼️ Your coding agent bec…☆88,792Updated this week
- Browser automation CLI for AI agents☆40,878Updated this week
- CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies☆76,492Updated this week
- Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph. A /graphify skill for Claude Code, Cu…☆107,789Updated this week
- Lightpanda: the headless browser designed for AI and automation☆34,068Updated this week
- Use Garry Tan's exact Claude Code setup: 23 opinionated tools that serve as CEO, Designer, Eng Manager, Release Manager, Doc Engineer, an…☆128,528Updated this week