Profile-guided GPU kernel optimizer for AMD/RDNA3. Auto-tunes llama.cpp MMVQ kernels per model shape. 2x decode speedup on 7900 XTX.
☆61Jul 7, 2026Updated last week
Alternatives and similar repositories for kernel-anvil
Users that are interested in kernel-anvil are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A high-throughput and memory-efficient inference and serving engine for LLMs - Optimized for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI…☆70Jun 23, 2026Updated 3 weeks ago
- ☆16Mar 15, 2026Updated 3 months ago
- Fresh builds of llama.cpp with AMD ROCm™ 7 acceleration☆600Updated this week
- Llama.cpp runner/swapper and proxy that emulates LMStudio / Ollama backends☆60Aug 21, 2025Updated 10 months ago
- NEW ROCmfp4 format for llama.cpp☆132Jun 13, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- RDNA-native LLM inference engine in Rust.☆482Updated this week
- LLM training & inference in python/C++ with web UI☆36Updated this week
- Fast fp16-fp8 mixed precision matmul on RDNA3/3.5 GPUs without native fp8☆33Updated this week
- Tiny evaluation of leading LLMs on competitive programming problems☆14Apr 10, 2026Updated 3 months ago
- minimal fill-in-the-middle autocomplete for vscode/codium, for use with llama.cpp infill or any openai-compatible server☆16May 10, 2026Updated 2 months ago
- ☆62Jul 10, 2025Updated last year
- Thin wrapper around GGML to make life easier☆48Nov 5, 2025Updated 8 months ago
- ☆50Updated this week
- Decentralizing distribution of open-source AI models.☆15Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Project code for training LLMs to write better unit tests + code☆22May 19, 2025Updated last year
- Community maintained mobile app for use with Lemonade. Join our discord: https://discord.gg/5xXzkMu8Zk☆41Jul 4, 2026Updated last week
- RedMatic based Homematic UI☆14Apr 15, 2019Updated 7 years ago
- Load and run Llama from safetensors files in C☆15Oct 24, 2024Updated last year
- Check if your server satisfies all the requirements to run the specific Laravel version.☆13Jun 20, 2019Updated 7 years ago
- A systematic empirical study of self-verification strategies in agentic coding harnesses☆29Mar 4, 2026Updated 4 months ago
- Desktop application for instant AI-powered text transformation. Translate, correct, summarize, and change the tone of any text, anywhere, …☆35Dec 29, 2025Updated 6 months ago
- High-performance late-interaction retrieval engine for on-prem AI. ColBERT/ColPali multi-vector search with Rust fused MaxSim, Triton GPU…☆17Jul 6, 2026Updated last week
- Extract a single expert from a Mixture Of Experts model using slerp interpolation.☆19May 26, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Enclosed chamber-type Delta 3d printer design☆11Aug 28, 2023Updated 2 years ago
- High-performance LLM inference engine — drop-in replacement for Ollama with faster multi-turn inference, lower TTFT, and higher throughpu…☆165Updated this week
- LLM inference in C/C++☆196Updated this week
- OpenMOSS pure C++ pipeline based on GGML☆58Updated this week
- ROCmFPX Family for AMD Hardware and Processors. More quants and special agent quants☆107Updated this week
- DEPRECATED. Moved to elm-community/json-extra =>☆10Jun 16, 2016Updated 10 years ago
- A high-performance FastAPI-based server that provides OpenAI-compatible Text-to-Speech (TTS) endpoints using the Orpheus TTS https://gith…☆31Nov 15, 2025Updated 7 months ago
- vLLM Qwen 3.6-27B (AWQ-INT4) + DFlash speculative decoding on AMD Strix Halo (gfx1151 iGPU, 128 GB UMA, ROCm 7.13). 24.8 t/s single-strea…☆46May 10, 2026Updated 2 months ago
- Local LLM Server Manager + LlaMA.cpp + Chat☆17Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Llama.cpp launcher with integrated huggingface☆59Jun 25, 2026Updated 2 weeks ago
- prompt engineering experiments with DSPy GEPA and TextGrad☆70Sep 2, 2025Updated 10 months ago
- Running headful chrome on custom lambda container image☆16Jan 17, 2021Updated 5 years ago
- firecracker-in-docker is a proof of concept project to run Firecracker MicroVMs inside unprivileged Docker containers.☆20May 16, 2022Updated 4 years ago
- Recommendation System | Machine Learning | Deep Learning | Convolutional neural network (CNN) | K-Nearest Neighbors Algorithm (KNN) | Kag…☆11Oct 16, 2021Updated 4 years ago
- HuggingFace transformer compiler for optimised native inference binaries☆39Apr 1, 2026Updated 3 months ago
- AMD Strix Halo / Ryzen AI Halo local LLM setup and benchmark guide for Ryzen AI MAX+ 395 and Radeon 8060S: Ollama, llama.cpp Vulkan/RADV,…☆215Updated this week