DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm
☆22,753Sep 20, 2026Updated last week
Alternatives and similar repositories for ds4
Users that are interested in ds4 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI☆110,034Updated this week
- Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦☆38,090Updated this week
- LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar☆22,330Updated this week
- The agent that grows with you☆249,711Updated this week
- LLM inference in C/C++☆129,780Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- The open source coding agent.☆210,578Updated this week
- AI agents running research on single-GPU nanochat training automatically☆96,934Mar 26, 2026Updated 6 months ago
- Run frontier AI locally.☆47,668Updated this week
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.☆76,903Updated this week
- an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM☆54,733Updated this week
- Lightweight coding agent that runs in your terminal☆126,948Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆92,871Updated this week
- MLX: An array framework for Apple silicon☆28,585Updated this week
- A tool for creating and running Linux containers using lightweight virtual machines on a Mac. It is written in Swift, and optimized for A…☆50,347Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ⌥ Coding agent with the IDE wired in. Built by Stencil Labs.☆33,601Updated this week
- Open-source coding agent for your terminal, built in Rust and on a journey of continuous community improvement. Issues and PRs welcome.☆41,036Updated this week
- The best ChatGPT that $100 can buy.☆58,307Sep 7, 2026Updated 3 weeks ago
- Scale computer-use 2.0 with open-source drivers, cross-OS fleets, and benchmarks for training, evaluation, and data generation.☆26,858Updated this week
- Skills for Real Engineers. Straight from my .agents directory.☆271,173Updated this week
- An agentic skills framework & software development methodology that works.☆292,426Updated this week
- DFlash: Block Diffusion for Flash Speculative Decoding☆6,126Aug 18, 2026Updated last month
- The AI that really does things. Any OS. Any Platform. The lobster way. 🦞☆390,714Updated this week
- The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails…☆59,787Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A lightweight alternative to OpenClaw that runs in containers for security. Connects to WhatsApp, Telegram, Slack, Discord, Gmail and oth…☆30,857Updated this week
- Python tool for converting files and office documents to Markdown.☆187,435Sep 21, 2026Updated last week
- Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for…☆74,012Updated this week
- DeepSpec: a full-stack codebase for training and evaluating speculative decoding algorithms☆7,174Jul 9, 2026Updated 2 months ago
- Symphony turns project work into isolated, autonomous implementation runs, allowing teams to manage work instead of supervising coding ag…☆27,434Sep 15, 2026Updated 2 weeks ago
- The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B…☆2,469Updated this week
- Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.☆181,856Updated this week
- Warp is an agentic development environment, born out of the terminal.☆65,231Updated this week
- LLM speculative inference server for heterogeneous hardware & consumer GPUs☆2,885Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- 🎨 Best DeepSeek Harness Design Plugin. The open-source Claude Design alternative. 🖥️ Local-first desktop app. 🖼️ Your coding agent bec…☆98,472Updated this week
- Browser automation CLI for AI agents☆43,312Updated this week
- CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies☆81,900Updated this week
- Lightpanda: the headless browser designed for AI and automation☆35,627Updated this week
- Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph. A /graphify skill for Claude Code, Cu…☆122,065Updated this week
- An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, s…☆83,155Updated this week
- Use Garry Tan's exact Claude Code setup: 23 opinionated tools that serve as CEO, Designer, Eng Manager, Release Manager, Doc Engineer, an…☆134,390Updated this week