llama.cpp fork for running Qwen3.8-Flash-Next V3 (95.5 GiB) on a 64 GB Apple Silicon Mac by streaming MoE experts from SSD. Setup guide: docs/qwen38-flash-next-v3.md
☆13Sep 19, 2026Updated last month
Alternatives and similar repositories for llama.cpp
Users that are interested in llama.cpp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM inference in C/C++☆58Sep 26, 2026Updated last month
- a vscode extension to show OpenAI Codex rate limit info in the status bar☆12Nov 8, 2025Updated 11 months ago
- TMK Keyboard Firmware for PokerII☆15Jul 4, 2019Updated 7 years ago
- The fastest inference engine for Qwen3.8-27B on the NVIDIA RTX 5090: up to 500 tokens/s for one agent and up to 2,000 tokens/s for many, …☆52Updated this week
- ☆16Oct 29, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A fast, focused Markdown reader and editor for Windows.☆12Jul 18, 2026Updated 3 months ago
- A tauri template with a nice Tailwind UI made with vue that includes core functionality for full functional apps.☆14Oct 7, 2026Updated 3 weeks ago
- A bootloader and experimentation playground for Apple Silicon☆13Updated this week
- A Docker Sandbox for running the Pi agent locally with a model served by oMLX.☆18Oct 4, 2026Updated 3 weeks ago
- ☆38Oct 22, 2026Updated last week
- This JavaScript project provides an ActiveRecord-esque API for the Google Gears SQLite database.☆11May 7, 2008Updated 18 years ago
- Claude Code plugin — delegate bulky research & first-draft work to Google Gemini, then review and finish with Claude.☆22Updated this week
- Crowdsources the entries from the Github contest and generates a new entry☆15Aug 28, 2009Updated 17 years ago
- ☆13Nov 19, 2024Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Local AI model manager☆16May 21, 2026Updated 5 months ago
- Obsidian community plugin: your vault as a private, self-hosted NotebookLM alternative. A built-in manager downloads and runs local AI mo…☆11Updated this week
- A javascript library for rating with Ajax (base on prototype)☆13Jun 22, 2008Updated 18 years ago
- An RDNA4 R9700 AI Pro ComfyUI patch for MiniMax H3 to speed up video generation.☆34Aug 8, 2026Updated 2 months ago
- Run large Mixture-of-Experts language models well on the memory you have.☆21Oct 24, 2026Updated last week
- A lightweight macOS app for LLM API proxying — automatic format translation (Anthropic ↔ OpenAI), parameter injection, model mapping, and…☆10Jul 24, 2026Updated 3 months ago
- Download any files directly to the google drive. It uses Google colab to download files.☆12May 27, 2020Updated 6 years ago
- Rack for JRuby and Java appservers☆15Sep 6, 2011Updated 15 years ago
- Empirical benchmarks and quality evaluations of Qwen3.8-27B with Multi-Token Prediction (MTP) across Splash, MTPLX, MLX, and llama.cpp on…☆21Sep 21, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Content for ODSC west adversarial machine learning talk☆10Oct 30, 2017Updated 9 years ago
- ☆13Nov 15, 2023Updated 2 years ago
- A custom node for ComfyUI that enables integration with Google Sheets. It allows reading from and writing to Google Sheets directly from …☆12Nov 2, 2024Updated 2 years ago
- ☆13May 22, 2024Updated 2 years ago
- dockerfiles, compose files, benchmarks for 2x R9700 serving☆27Oct 15, 2026Updated 2 weeks ago
- Minimalist repo to do mlx vlm constrained decoding in batch mode☆20Apr 11, 2026Updated 6 months ago
- Running DeepSeek-V4-Flash (284B MoE) on a 64 GB Mac by streaming experts from SSD — a measurement lab: cache-size sweeps, prefetch and sp…☆13Aug 18, 2026Updated 2 months ago
- AsusWRT-Merlin feature expansion that automatically creates separated subnets from lan network, based on the active guest network and set…☆24Mar 10, 2026Updated 7 months ago
- Master Audio Controller for MAC☆12Jun 9, 2026Updated 4 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Easy local FLUX.1 Inference☆11Aug 29, 2024Updated 2 years ago
- a ruby interface for Facebook's Platform and Open Platform APIs☆15Jun 28, 2008Updated 18 years ago
- Native UEFI/EFI utility for Intel CPU power management (2nd-15th Gen). Direct MSR/MMIO access for undervolting, power limits, and V/F cur…☆26Sep 7, 2026Updated last month
- Modern Bootloader for Quansheng UV-K5 (V3) and Variants☆12Dec 31, 2025Updated 10 months ago
- A Floating Div based on Prototype shown on top of the page to inform users that there is an operation in process.☆16Jul 29, 2009Updated 17 years ago
- H3MLX: MiniMax-H3 Metal 4 / Pure C Video Gen Master Suite, Benchmark Matrix & AI Agent Skill for Apple Silicon☆23Sep 6, 2026Updated last month
- Robust and Approximate Markov Decision Processes☆12Jul 21, 2017Updated 9 years ago