GLM-5.3-Flash EXL3 on one 24 GB RTX 3090 + DDR4: elastic GPU expert cache, zero-copy experts, AVX2 CPU tier, OpenAI API
☆349Oct 18, 2026Updated 2 weeks ago
Alternatives and similar repositories for glm-flash-lite
Users that are interested in glm-flash-lite are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Qwen3.8-Flash-Next on one Intel Arc Pro B70 with experts on NVMe and 32 GB host RAM: SGLang + exl3xpu tier, staged NVMe prefill, SYCL spa…☆21Oct 8, 2026Updated 3 weeks ago
- Run GLM-5.3-Flash (321B), DeepSeek-V4.1-Flash (748B) and MiniMax-M3.1-Flash (428B) on your own GPUs - one engine, one dashboard, OpenAI- …☆2,585Updated this week
- Qwen3.8-Flash-Next at full 262k context on 8 GB RAM and 16 GB VRAM—20 tok/s generation and 1,600 tok/s prefill.☆63Oct 26, 2026Updated last week
- DeepSeek-V4.1-Flash-1017 (552B MoE + 196B Engram) on 2x RTX 3090 + 128 GB RAM. Rust + CUDA, T16 quantization. 40+ tok/s measured with exp…☆91Updated this week
- ☆41Aug 16, 2026Updated 2 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Delta Inference Engine: DeepSeek-V4.1-Flash on one NVIDIA GPU, natively on Windows (OpenAI-compatible server)☆65Updated this week
- One llama.cpp flag unlocks +33-39% decode speed for Qwen3.8-27B on consumer GPUs. The MTP head already ships inside your GGUF. Recipe, pa…☆367Sep 26, 2026Updated last month
- Qwen3.8-27B on 16-32 GB Nvidia GPUs one-click install for Windows / Linux☆600Oct 9, 2026Updated 3 weeks ago
- Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on loca…☆40,925Updated this week
- Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on loca…☆21Updated this week
- Local AI registry: one validated recipe per machine, with the evidence attached☆290Updated this week
- Qwen3.8-Flash-Next (125B MoE) on a 8GB+ Multi Vendor GPU 🥳No CUDA！☆321Oct 30, 2026Updated last week
- Experimental llama.cpp fork for inference research and development☆900Updated this week
- LLM speculative inference server for heterogeneous hardware & consumer GPUs☆2,976Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- LLM Inference Engine for Metal, CUDA and Vulkan.☆1,677Updated this week
- The agent that grows with you☆14Oct 14, 2026Updated 3 weeks ago
- DeepSeek-V4.1-Flash on two DGX Sparks: EXL3 routed experts, 262k context, 2M-token KV, vision, tools, MTP, bundled with Pi☆96Oct 3, 2026Updated last month
- Your GeForce runs AI at half speed. This fixes it for 20/30/40 series cards. Up to 2× FP16 / BF16 / TF32 tensor throughput☆17,323Oct 29, 2026Updated last week
- Xolotl (formerly Strata-DSV4.1): run DeepSeek-V4.1-Flash, all 552B, as a local coding agent on one gaming PC (RTX 4090 + 90 GB RAM) at up…☆467Updated this week
- Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith …☆887Updated this week
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆1,794Updated this week
- ☆15Oct 15, 2026Updated 3 weeks ago
- Strata-based GLM 5.3 Flash runner☆19Updated this week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆24Sep 20, 2026Updated last month
- LLM inference in C/C++☆56Aug 8, 2026Updated 2 months ago
- ☆17Oct 2, 2026Updated last month
- ☆21Oct 21, 2026Updated 2 weeks ago
- Qwen3.8-Flash-Next (125B MoE) up to 1M context on one or two RTX cards (tuned on 3080 10gb). A measured, tuned and benchmarked fork of …☆43Updated this week
- Fast fork of llama.cpp designed for Qwen3.8-Flash-Next☆306Updated this week
- Run a big model on your own GPU, measure it with one protocol, and submit the result. Intake for local-ai-registry recipes.☆23Updated this week
- An intuitive console agent to fine-tune AI models with little to no experience required!☆212Oct 5, 2026Updated last month
- ☆20Sep 17, 2026Updated last month
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Tile primitives for speedy kernels☆21Sep 13, 2026Updated last month
- Easy local setup for Qwen3.8-27B Abliterated: 256K context and measured 240-300 tokens/s generation on an RTX 5090.☆33Sep 20, 2026Updated last month
- SSD-streaming inference engine for giant MoE models (Rust + CUDA). GLM 5.2 743B at 2 tok/s and Hy3 295B at 7 tok/s on two consumer 16GB G…☆234Sep 1, 2026Updated 2 months ago
- A locally running AI image blocker for Chrome☆46Aug 31, 2026Updated 2 months ago
- Unlock P2P comms between consumer NVIDIA GPUs☆697Oct 26, 2026Updated last week
- 🐾 Complete REST API for ClawHub skills marketplace data☆16Apr 6, 2026Updated 7 months ago
- Live OSINT globe for Hermes Desktop: earthquakes, disasters, aircraft, satellites, news incidents, recon and agent briefings from public …☆21Updated this week