NEW ROCmfp4 format for llama.cpp
☆132Jun 13, 2026Updated last month
Alternatives and similar repositories for rocmfp4-llama
Users that are interested in rocmfp4-llama are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ROCmFPX Family for AMD Hardware and Processors. More quants and special agent quants☆107Updated this week
- AMD Strix Halo / Ryzen AI Halo local LLM setup and benchmark guide for Ryzen AI MAX+ 395 and Radeon 8060S: Ollama, llama.cpp Vulkan/RADV,…☆215Updated this week
- ☆55Jun 8, 2026Updated last month
- RDNA-native LLM inference engine in Rust.☆482Updated this week
- Open-source self-hosted home AI inference platform for AMD Strix Halo — multi-backend slots, OpenAI-compatible gateway, Vue 3 + FastAPI +…☆56Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- vLLM Qwen 3.6-27B (AWQ-INT4) + DFlash speculative decoding on AMD Strix Halo (gfx1151 iGPU, 128 GB UMA, ROCm 7.13). 24.8 t/s single-strea…☆46May 10, 2026Updated 2 months ago
- ☆22Updated this week
- ☆66Updated this week
- LLM inference in C/C++☆81Updated this week
- Curated AMD GPU compatibility index and CLI for AI workloads☆31May 23, 2026Updated last month
- ☆50Updated this week
- Fast LLM speculative inference server for consumer hardware.☆2,656Updated this week
- Official repository of AMD Playbooks☆73Updated this week
- Decentralizing distribution of open-source AI models.☆15Updated this week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Fork of turbo quant tom-tom and TurboQuant KV cache from domwox☆29Jul 7, 2026Updated last week
- LLAMA Turboquant implementation with CUDA support☆687Updated this week
- moss-transcribe.cpp is a from-scratch C++17 inference port of OpenMOSS MOSS-Transcribe-Diarize, built on ggml☆16Updated this week
- Fused TBQ4 Flash Attention + MTP + Shared Tensors for llama.cpp — 82+ tok/s with lossless 4.25 bpv KV cache at 200K context on RTX 4090☆88May 17, 2026Updated last month
- ☆1,758Updated this week
- OpenAI STT custom component for HA☆11Jan 25, 2024Updated 2 years ago
- ☆16Mar 15, 2026Updated 3 months ago
- Local-first CLI for benchmarking LLMs on real hardware — quality, speed, reliability, and a real multi-turn agent loop.☆39May 26, 2026Updated last month
- Fast fp16-fp8 mixed precision matmul on RDNA3/3.5 GPUs without native fp8☆33Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- LLM inference in C/C++☆63May 7, 2026Updated 2 months ago
- 💜 The slightly more compromising Python code formatter☆11Feb 26, 2021Updated 5 years ago
- llama.cpp fork with TQ3_1S/4S CUDA kernels — 3.5-bit WHT quantization achieving Q4s quality at 10% smaller size. Based on RaBitQ-inspired…☆219Jul 6, 2026Updated last week
- A fuzzy finder with GUI (inspired by fzf)☆14Oct 29, 2020Updated 5 years ago
- A Go implementation of the HOTP (RFC 4226) and TOTP (RFC 6238) algorithms.☆21Updated this week
- CLI secret management☆16Updated this week
- Jailer is an eBPF-based process jailing system that provides mandatory access control (MAC) for Linux. It tracks processes using BPF task…☆57Mar 16, 2026Updated 3 months ago
- LLM training & inference in python/C++ with web UI☆36Updated this week
- SR²AM: Efficient Agentic Reasoning Through Self-Regulated Simulative Planning☆21May 22, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆248Oct 30, 2025Updated 8 months ago
- ggml port of CED SOTA-tier audio-tagging model that classifies everyday sounds☆94Jun 25, 2026Updated 2 weeks ago
- grom — btop-style terminal dashboards for Prometheus & Grafana☆15Updated this week
- LLM inference in C/C++☆2,097Updated this week
- ia-search | internet archive file browser☆36Apr 20, 2026Updated 2 months ago
- ☆38Sep 29, 2025Updated 9 months ago
- This is a mirror of the Strix Halo HomeLab wiki, to browse the wiki click on the link below☆67Updated this week