DeepSeek-V4.1-Flash EXL3 on one 24 GB RTX 3090 + DDR4 + NVMe: staged-DMA prefill, AVX2 CPU expert tier, elastic VRAM expert cache, Engram on disk, OpenAI API
☆155Oct 12, 2026Updated 3 weeks ago
Alternatives and similar repositories for dsv41-flash-offload
Users that are interested in dsv41-flash-offload are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆50Updated this week
- Run GLM-5.3-Flash (321B), DeepSeek-V4.1-Flash (748B) and MiniMax-M3.1-Flash (428B) on your own GPUs - one engine, one dashboard, OpenAI- …☆2,585Updated this week
- GLM-5.3-Flash EXL3 on one 24 GB RTX 3090 + DDR4: elastic GPU expert cache, zero-copy experts, AVX2 CPU tier, OpenAI API☆349Oct 18, 2026Updated 2 weeks ago
- DeepSeek-V4.1-Flash on two DGX Sparks: EXL3 routed experts, 262k context, 2M-token KV, vision, tools, MTP, bundled with Pi☆96Oct 3, 2026Updated last month
- Cryptographic signature algorithms: DSA, ECDSA, Ed25519☆11Nov 7, 2025Updated 11 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Code for Latent Sparse Attention: Towards Subquadratic Ultra-Long Context Attention☆421Updated this week
- Qwen3.5-2B with a filesystem compiled and inserted directly into its weights.☆91Updated this week
- Xolotl (formerly Strata-DSV4.1): run DeepSeek-V4.1-Flash, all 552B, as a local coding agent on one gaming PC (RTX 4090 + 90 GB RAM) at up…☆467Updated this week
- Self-hosted, OpenAI-compatible speech-to-text API with pluggable ASR backends (Whisper, GigaAM)☆40Sep 28, 2026Updated last month
- Qwen3.8-27B on 16-32 GB Nvidia GPUs one-click install for Windows / Linux☆600Oct 9, 2026Updated 3 weeks ago
- Fastest validated sglang recipe for Qwen3.8-27B (AWQ-INT4 + DSpark) on RTX 3090s — 1×/2×/4× GPU presets, image+video, full benchmarks☆64Oct 17, 2026Updated 3 weeks ago
- Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when …☆2,580Updated this week
- XMR402 is an open, neutral standard for internet-native payments. It absolves the Internet's original sin by natively making payments pos…☆11Oct 27, 2026Updated last week
- Production-grade convergence & anti-overthinking steering extension for Pi Coding Agent (tuned for Bonsai 2 / Qwen)☆18Sep 21, 2026Updated last month
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on loca…☆40,925Updated this week
- ☆62Updated this week
- SpecPilot: Autonomous Algorithm Discovery and Systems Optimization for Speculative Decoding☆168Updated this week
- Use Claude Code subscription as LLM provider for Pi without breaking Anthropic ToS.☆37Updated this week
- Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable☆28Oct 6, 2026Updated last month
- DSV4.1-Flash-1017 SAGE EXL3 (1.62 bpw) on one DGX Spark with vLLM: DSpark MTP, cold-expert ATS alias, tile-K 16 MoE, memory guard, measur…☆40Updated this week
- Qwen3.8-Flash-Next on one Intel Arc Pro B70 with experts on NVMe and 32 GB host RAM: SGLang + exl3xpu tier, staged NVMe prefill, SYCL spa…☆21Oct 8, 2026Updated 3 weeks ago
- Control LLM generation format efficiently. A simple version of microsoft/aici in vllm and transformers☆14Jun 7, 2024Updated 2 years ago
- Open-source voice companion firmware for the M5Stack StackChan (CoreS3, ESP32-S3): xiaozhi-based, Hermes Agent brain, anime faces, dance,…☆29Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Strata for a PC with two NVIDIA GPUs and 32 GB of RAM: the low-RAM mode on a layer split, both cards working at the same time. 143 tok/s …☆84Oct 6, 2026Updated last month
- Bitcoin light client implementation for Near Protocol☆16Updated this week
- Sushi engine runs very high quality quant model in Apple Silicon, using both STQ and EXL3 format with special tuning technology.☆421Updated this week
- Deployment kit: Qwen3.8-27B EXL3 3.5bpw target + DFlash2 EXL3 5.0bpw speculative draft — launcher, config, model cards☆233Sep 1, 2026Updated 2 months ago
- An LLM running on an NPU inside an LLM. Karpathy's stories260K writing stories on a vector unit compiled into Qwen3.5-4B's weights.☆125Updated this week
- Run a 110B on a 2016 PC with 16 GB RAM. Know your tok/s before you download. Placement beats budget: predicts speed + memory fit for any …☆93Oct 7, 2026Updated last month
- 为deepseek harness做了一个tui界面，方便开发者直接在终端使用☆19Aug 16, 2026Updated 2 months ago
- 中文推文与文章的诊断、创作和精修 Skill☆40Aug 31, 2026Updated 2 months ago
- ☆16Oct 20, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- llama.cpp fork for significantly improved performance on Ampere generation Nvidia cards (especially RTX 3090 / 3090 Ti): example: 110+ to…☆223Updated this week
- AgentParse is a high-performance parsing library designed to map various structured data formats (such as Pydantic models, JSON, YAML, an…☆18Oct 13, 2025Updated last year
- Qwen3.8-27B on One RTX 3090: 14 hours of measurements. Vision crash fix, VRAM math, MTP tuning, quantisation comparison, and 9 pieces of …☆12Aug 17, 2026Updated 2 months ago
- Skill làm phim hoạt hình ngắn trên Muse AI — từ ý tưởng đến MP4: nhân vật, kịch bản, keyframes, mega prompt, video, thuyết minh, dựng phi…☆45Oct 31, 2026Updated last week
- Strata fork: Qwen3.8-Flash-Next 125B MoE in NVFP4 on one RTX 20-50 card (12 GB+) and 64 GB of RAM or more. Setup installs our GPTQ quants…☆224Oct 24, 2026Updated last week
- ☆20Jun 4, 2026Updated 5 months ago
- iOS swift 扫描线种子填充算法 涂鸦☆17Jun 1, 2021Updated 5 years ago