LLM inference in C/C++
☆81Jul 9, 2026Updated this week
Alternatives and similar repositories for CachyLLama
Users that are interested in CachyLLama are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Local LLM Server Manager + LlaMA.cpp + Chat☆17Updated this week
- Open-source self-hosted home AI inference platform for AMD Strix Halo — multi-backend slots, OpenAI-compatible gateway, Vue 3 + FastAPI +…☆56Updated this week
- ☆50Updated this week
- RDNA-native LLM inference engine in Rust.☆482Updated this week
- AI agent framework, written from scratch (not based on openclaw), focused on stripping it down to the bare necessities, optimizing token …☆398Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- NEW ROCmfp4 format for llama.cpp☆132Jun 13, 2026Updated last month
- Interactive Jacobian-Lens visualizer and live steerer for GGUF models on llama.cpp☆63Updated this week
- Auto-tuned launcher for GGUF models on llama.cpp / ik_llama.cpp — OpenAI-compatible server with multi-GPU tensor-split, MoE expert placem…☆252Updated this week
- AMD Strix Halo / Ryzen AI Halo local LLM setup and benchmark guide for Ryzen AI MAX+ 395 and Radeon 8060S: Ollama, llama.cpp Vulkan/RADV,…☆215Updated this week
- ☆20Updated this week
- Vault-native meeting capture. Timestamped notepad + local transcription + Claude Code skill that distills into Obsidian notes connected t…☆32Apr 20, 2026Updated 2 months ago
- DFlash & TurboQuant in llama.cpp with up to 3x faster generation and 7.5x more KV cache in same VRAM☆772Updated this week
- Interactive terminals for AI agents, built for what you can't --yes away. SSH+MFA, GRUB/U-Boot, debconf installers, SOL/serial consoles, …☆91Mar 18, 2026Updated 3 months ago
- self-extending sandboxed agentic harness. a loop, two tools and an llm☆100Jul 2, 2026Updated last week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆16Mar 15, 2026Updated 3 months ago
- A complete package that provides you with all the components needed to get started of dive deeper into Machine Learning Workloads on Cons…☆55Jun 25, 2026Updated 2 weeks ago
- AI coding agent optimized for small LLMs. 87% benchmark with 4B-active model.☆1,985Jun 20, 2026Updated 3 weeks ago
- A harness optimized to smaller LLMs☆1,754Jul 6, 2026Updated last week
- ☆1,758Updated this week
- ☆55Jun 8, 2026Updated last month
- 📑 Click and fill form or job application easily☆15Nov 1, 2020Updated 5 years ago
- MCP server for creating UI flowcharts☆11Jan 5, 2025Updated last year
- 15 creative techniques. Intensity slider 0.3-1.0. Drunk fusion mode merges with Drunk Claude. 4 output styles including playing cards. Tr…☆20Jun 27, 2026Updated 2 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- the unofficial poimandres theme for ghostty terminal☆18Jul 1, 2025Updated last year
- Pi coding agent extension: llama.cpp provider with dynamic model + context window discovery☆63Jul 6, 2026Updated last week
- pi.dev + llama.cpp ❤️☆22Jul 6, 2026Updated last week
- 🛡️ Battle-tested 4-tier backup strategy for OpenClaw — Linux, macOS, and Windows☆34Jun 3, 2026Updated last month
- An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, a…☆633Updated this week
- world's stupidest moe llm in 103M parameters☆20Jul 18, 2025Updated 11 months ago
- Row-wise block scaling for fp8 quantization matrix multiplication. Solution to GPU mode AMD challenge.☆19Feb 9, 2026Updated 5 months ago
- LLamaHTML is a simple html file to communicate with a running llamacpp llama-server☆24Aug 5, 2025Updated 11 months ago
- VecoLuc is a scalable vector search engine that leverages Apache Lucene and the JDK's incubator vector API for high-performance vector op…☆11Aug 22, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- AutoTile tileset generator for Unity☆10Jul 5, 2019Updated 7 years ago
- A curated list of apps, tools, and resources designed for ADHD brains — not adapted from neurotypical productivity systems. M…☆41Feb 20, 2026Updated 4 months ago
- Run llama.cpp server with Vulkan☆19Feb 1, 2026Updated 5 months ago
- Decentralizing distribution of open-source AI models.☆15Updated this week
- An associative memory system that stores and retrieves experiences using the 5W1H framework (Who, What, When, Where, Why, How) and conten…☆172Sep 15, 2025Updated 9 months ago
- Same-day replication + extensions of Anthropic's global-workspace paper on Gemma 4 — emotion probes, hallucination prediction, 16GB-GPU r…☆43Updated this week
- Orchestrate an entire AI dev team on 5GB VRAM. Ephemeral subagents, exact-match diffs. Single static binary, any model. Zero config, zero…☆379Updated this week