Qwen3.8-27B EXL3 (4.00 bpw) + DFlash2 speculative decoding for ExLlamaV3, validated at 262k context on a 24 GB RTX 3090
☆25Sep 20, 2026Updated last month
Alternatives and similar repositories for qwen38-exl3-dflash2
Users that are interested in qwen38-exl3-dflash2 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆51Updated this week
- ☆16Jun 28, 2026Updated 4 months ago
- Qwen3.8-27B on one DGX Spark GB10: DFlash 2 for 65 tok/s C1 and 120 C4; EAGLE 3/1/4 for ~191 C8, ~330 C16 and ~535 C32; native 262K, pinn…☆13Oct 6, 2026Updated last month
- An update to the old simple-calc☆10Dec 22, 2025Updated 10 months ago
- Unofficial self-hosted Cloudflare OS Home with Docker Compose, project-local LiteLLM, Tailscale, and an agent-first runtime.☆14Oct 3, 2026Updated last month
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Fully offline meeting notetaker for macOS — records, transcribes, and summarizes on-device with Whisper and a local LLM. Meeting detectio…☆20Aug 14, 2026Updated 2 months ago
- Easily run LLMs locally using llama.cpp directly, without overhead.☆21Aug 15, 2026Updated 2 months ago
- A community-owned map of LLM inference engine configurations — benchmarks, evals and coverage gaps, hosted on GitHub Pages. The repo is t…☆16Oct 19, 2026Updated 2 weeks ago
- Blazor, ASP.NET Core, Xamarin, .NET Standard <3☆14Dec 8, 2022Updated 3 years ago
- Rotate between multiple OpenCode Go API keys with automatic rate-limit detection☆12Sep 18, 2026Updated last month
- Self-hosted cloud server for Laravel Nightwatch monitoring agent☆17Sep 30, 2026Updated last month
- ☆39Updated this week
- Getting Qwen's Qwen4-architecture preview (Qwen3.8-Flash-Next) to run on a single DGX Spark GB10 — 125.9 GiB of weights against 117 GiB o…☆21Oct 14, 2026Updated 3 weeks ago
- Real-time stock price alerts built to learn system design: Laravel API with a transactional outbox, Node evaluator on Kafka (Redpanda), R…☆16Oct 29, 2026Updated last week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A build playbook that turns your coding agent into the foreman of a website build. It interviews you, forces the design and scope decisio…☆33Updated this week
- Qwen3.8-Flash-Next on one DGX Spark: tuned vLLM launch, context sweep, tuning ladder. By @redp314☆21Sep 21, 2026Updated last month
- Strata-based GLM 5.3 Flash runner☆20Updated this week
- Ship iOS and Android apps from your AI agent. MCP server for App Store Connect, Google Play Console and Expo EAS.☆19Oct 2, 2026Updated last month
- Uxnan (pronounced /uʃ.nan/) is a suite of tools I built to solve a very specific problem I face as a developer: managing AI-powered codin…☆38Updated this week
- AiiStream Q3.6: byte-identical MoE expert streaming on Apple Silicon — runs Qwen3.6-35B-A3B on a 16 GB Mac☆17Sep 29, 2026Updated last month
- ☆13Dec 9, 2025Updated 10 months ago
- Home Assistant integration explaining the financial impact of per-device energy usage☆25Updated this week
- A very-low-resource API-compatible replacement for Ray☆13Nov 1, 2026Updated last week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- vLLM recipe: GLM-5.3-Flash EXL3 K2 on one DGX Spark GB10. Native MTP k=2. Measured tok/s.☆26Sep 10, 2026Updated last month
- Moved to nace-ai/drex-decision-models (archived)☆34Oct 9, 2026Updated 3 weeks ago
- A database client for the terminal: MySQL, MariaDB, PostgreSQL, SQLite, and hosted ones like Neon, Supabase and PlanetScale. Shows you th…☆24Updated this week
- Force any Model, VAE, or CLIP to any GPU or CPU—and keep it there (or don't).☆37Feb 6, 2026Updated 9 months ago
- Turn the Hacker News front page into local AI art. Powered by mlx-vlm, MFlux, and Apple Silicon.☆35Aug 3, 2026Updated 3 months ago
- ☆10Jul 12, 2025Updated last year
- Pinned one-DGX-Spark Docker recipe for DeepSeek V4 Flash with EXL3, SparkInfer, and 262K NVFP4 MLA KV cache☆32Sep 6, 2026Updated 2 months ago
- VENDORIZED in lucebox-hub. Fork of llama.cpp, ggml graph for lucebox inference engine☆29Jul 8, 2026Updated 3 months ago
- Using a ESP32-S3 to emulate a GS-232 satellite rotator controller for gpredict☆13Jan 11, 2026Updated 9 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Archived fork of antirez/ds4 for GB10 DSpark — continues as Athena: github.com/xangel82/Athena-Engine☆28Oct 30, 2026Updated last week
- Chrome extension to display ChatGPT response alongside V2EX post☆16Dec 6, 2022Updated 3 years ago
- Concurrency Patch to enable on DSpark - DeepSeek V4 Flash/Pro C=16 can be modified for more☆12Jun 29, 2026Updated 4 months ago
- Tested MiaAI-based DeepSeek V4 Flash speed profile for two ASUS GX10s: pinned patch, settings, and benchmark helper.☆15Sep 5, 2026Updated 2 months ago
- fork from https://huggingface.co/spaces/innova-ai/video-background-removal/tree/main☆12Nov 10, 2024Updated last year
- Keyboard-first terminal dashboard for Coolify: deployments, live logs across your whole fleet, and an MCP server for your agent☆29Oct 21, 2026Updated 2 weeks ago
- ☆15Oct 15, 2026Updated 3 weeks ago