DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm
☆22,161Sep 8, 2026Updated this week
Alternatives and similar repositories for ds4
Users that are interested in ds4 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI☆103,095Updated this week
- Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦☆27,002Updated this week
- LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar☆21,529Updated this week
- LLM inference in C/C++☆127,505Updated this week
- The agent that grows with you☆243,452Updated this week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- The open source coding agent.☆205,880Updated this week
- AI agents running research on single-GPU nanochat training automatically☆95,416Mar 26, 2026Updated 5 months ago
- Run frontier AI locally.☆47,311Aug 25, 2026Updated 2 weeks ago
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.☆75,870Updated this week
- an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM☆54,031Updated this week
- Lightweight coding agent that runs in your terminal☆122,497Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆91,254Updated this week
- MLX: An array framework for Apple silicon☆28,348Updated this week
- A tool for creating and running Linux containers using lightweight virtual machines on a Mac. It is written in Swift, and optimized for A…☆49,768Updated this week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ⌥ Coding agent with the IDE wired in☆30,157Updated this week
- Open-source coding agent for your terminal, built in Rust and on a journey of continuous community improvement. Issues and PRs welcome.☆40,935Updated this week
- The best ChatGPT that $100 can buy.☆57,867Updated this week
- Scale computer-use 2.0 with open-source drivers, cross-OS fleets, and benchmarks for training, evaluation, and data generation.☆22,365Updated this week
- Skills for Real Engineers. Straight from my .agents directory.☆256,967Updated this week
- An agentic skills framework & software development methodology that works.☆283,357Updated this week
- The AI that really does things. Any OS. Any Platform. The lobster way. 🦞☆389,212Updated this week
- DFlash: Block Diffusion for Flash Speculative Decoding☆6,061Aug 18, 2026Updated 3 weeks ago
- The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails…☆58,280Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A lightweight alternative to OpenClaw that runs in containers for security. Connects to WhatsApp, Telegram, Slack, Discord, Gmail and oth…☆30,723Updated this week
- Python tool for converting files and office documents to Markdown.☆181,673Updated this week
- DeepSpec: a full-stack codebase for training and evaluating speculative decoding algorithms☆7,086Jul 9, 2026Updated last month
- Symphony turns project work into isolated, autonomous implementation runs, allowing teams to manage work instead of supervising coding ag…☆27,102Aug 19, 2026Updated 2 weeks ago
- Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for…☆70,647Updated this week
- Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.☆180,461Updated this week
- Warp is an agentic development environment, born out of the terminal.☆64,879Updated this week
- Run deepseek4 locally on metal right from within Pi☆170Aug 7, 2026Updated last month
- 3x faster speeds on MLX | Qwen 3.8 27B | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.☆2,172Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- LLM speculative inference server for heterogeneous hardware & consumer GPUs☆2,843Updated this week
- 🎨 Best DeepSeek Harness Design Plugin. The open-source Claude Design alternative. 🖥️ Local-first desktop app. 🖼️ Your coding agent bec…☆94,884Updated this week
- Browser automation CLI for AI agents☆42,194Updated this week
- CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies☆79,474Updated this week
- Lightpanda: the headless browser designed for AI and automation☆35,142Updated this week
- Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph. A /graphify skill for Claude Code, Cu…☆115,950Updated this week
- An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, s…☆82,067Updated this week