Caching experts made model agnostic for llama. Drastically speeds up generation speed on MoE models that fully fit in the RAM but partially in Vram. WIP: Same speedup but for models that don't fit in the ram either.
☆31Aug 6, 2026Updated 3 months ago
Alternatives and similar repositories for llama-wackMall
Users that are interested in llama-wackMall are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- RocketLLama. Fork off LLama cpp that newly scales 2-20x now also on big models not fully fitting in vram on even just 2 gpus☆16Updated this week
- Repairs predictable tool-call mistakes that often derail open weight models. Supports integration with other extensions' custom tools.☆13Jul 21, 2026Updated 3 months ago
- ☆25Apr 30, 2026Updated 6 months ago
- ☆31Aug 26, 2026Updated 2 months ago
- Multi-dataset evaluation of Anthropic's J-Space on Qwen3-4B. Demonstrates that internal 'workspace noise' can reliably route high-confide…☆12Jul 13, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Interactive Jacobian-Lens visualizer and live steerer for GGUF models on llama.cpp☆90Jul 12, 2026Updated 3 months ago
- ☆16Updated this week
- Graphic Devices for R based on NanoVG☆10Jun 15, 2018Updated 8 years ago
- Keep Pi conversation separate from tool output and agent activity.☆16Updated this week
- ☆13Oct 6, 2026Updated last month
- Enhances Kokoro TTS output by merging segments with dynamic, programmable pauses for meditative or narrative flow.☆17Oct 16, 2025Updated last year
- Ncomputing L130 PCB reverse engineering☆12Jun 11, 2026Updated 4 months ago
- Local-first AI workflow orchestration for chaining models, agents, tools, and scripts into repeatable workflows.☆33Aug 10, 2026Updated 3 months ago
- ☆10Oct 8, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Patch kit for making oh-my-opencode-slim and superpowers cooperate cleanly in OpenCode☆14Jul 15, 2026Updated 3 months ago
- A fast, terminal-based color picker with mouse support. Allows for color picking in RGBA, HSL, and CMYK.☆11Jun 30, 2022Updated 4 years ago
- Personal pi agent setup☆16Mar 16, 2026Updated 7 months ago
- Sillytavern memory plug-in. Simpler = better☆41Updated this week
- Pure C wrapper library to use llama.cpp with Linux and Windows as simple as possible.☆16Sep 6, 2026Updated 2 months ago
- Various fonts i've drawn.☆11May 29, 2021Updated 5 years ago
- Two environment variables that fix PyTorch/glibc memory creep on Linux. Zero code changes. Zero performance cost.☆15Jul 10, 2026Updated 4 months ago
- Self-hosted library for the reading workflow.☆12Updated this week
- ☆16Jul 12, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A terminal-based renderer for OpenGL shaders. Like Shadertoy, but in the terminal.☆12Sep 24, 2023Updated 3 years ago
- ☆12Dec 11, 2022Updated 3 years ago
- A light-weight curses-like header-only library. Good for terminal-based games and such.☆11Aug 10, 2026Updated 3 months ago
- A web frontend for managing an EmpyrionServer (similar to the EAH), as a MOD so that it can also be used seemless in game hosting.☆24Aug 3, 2026Updated 3 months ago
- Token-budgeted codebase discovery for agent shells and Pi: cross-language maps, focused navigation, and impact analysis.☆16Nov 2, 2026Updated last week
- Run RKLLM only in one docker command. Already converted models here.☆22Oct 23, 2026Updated 2 weeks ago
- gorynlich, 2d platform dungeon romp☆13Nov 8, 2021Updated 5 years ago
- Review Pi agent work, run visible tmux workers, and save evidence outside model context☆17Aug 10, 2026Updated 3 months ago
- hummingbird is a lightweight, zero dependency runtime for massive open source Mixture of Experts (MoE) language models. It unifies SSD, R…☆63Jul 31, 2026Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆10Nov 5, 2018Updated 8 years ago
- Draw a mandala with mirrored symmetry: pick the number of folds, paint with a brush, and export your mandala as PNG or SVG.☆15Oct 10, 2026Updated last month
- Claude Code skills for Indian stock market investors and traders — NSE/BSE analysis, F&O strategies, technical charting, fundamental scre…☆57Nov 2, 2026Updated last week
- z80pack on RP2040-GEEK and RP2350-GEEK☆24Aug 12, 2025Updated last year
- Run a 110B on a 2016 PC with 16 GB RAM. Know your tok/s before you download. Placement beats budget: predicts speed + memory fit for any …☆93Oct 7, 2026Updated last month
- Open-source LLMOps platform with prompt management, an OpenAI-compatible AI gateway, OpenTelemetry tracing, a versioned tool catalog, and…☆13Updated this week
- ☆16Feb 6, 2026Updated 9 months ago
Are these results useful?