Specialized fork for (relatively) fast single-GPU inference (in CUDA) using large MoE models that don't fit fully into VRAM
☆16May 6, 2026Updated 2 months ago
Alternatives and similar repositories for llama.cpp
Users that are interested in llama.cpp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Coding agent with cool features.☆16Jun 6, 2026Updated last month
- On-device speech SDK for Android — ASR, TTS, VAD, and noise cancellation powered by ONNX Runtime with Qualcomm NNAPI acceleration☆74Updated this week
- Open source tool for transcirption and subtitling, alternative to happyscribe.☆36Feb 12, 2025Updated last year
- Sherpa-onnx-tts-stt source for homeassisstant addon with Kroko Onnx Streaming STT integration.☆30Dec 18, 2025Updated 6 months ago
- Install micromamba, and optionally create a base conda environment.☆10Apr 5, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Attach a debug node to an output to get more information.☆14Jun 14, 2024Updated 2 years ago
- A CLI tool that simplifies Claude Code's hook system by replacing complex JSON configurations with clean YAML syntax, template-based data…☆33Updated this week
- Implementation for IceCache: Memory-Efficient KV-cache Management for Long-Sequence LLMs (ICLR 2026).☆19Jun 9, 2026Updated last month
- ScreenObject implements ScreenObject (PageObject) pattern in your tests. It also automatically generates classes with screen's elements. …☆12Dec 23, 2022Updated 3 years ago
- MusMorph, a database of standardized mouse morphology data for morphometric meta-analyses.☆12Jul 25, 2024Updated last year
- World's most accurate password guessing AI tool. A PyTorch implementation of PassLLM (USENIX 2025) that leverages PII and LoRA fine-tunin…☆109Updated this week
- RWKV-7 mini☆12Mar 29, 2025Updated last year
- record power consumption on thinkpads and create a gnuplot graph☆10May 8, 2019Updated 7 years ago
- ☆22Sep 7, 2025Updated 10 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Local banking voice assistant focused on banking☆68Apr 10, 2026Updated 3 months ago
- A2A MCP Server is a lightweight Python bridge that lets Claude Desktop or any MCP client talk to A2A agents. It provides three tools: reg…☆21May 4, 2025Updated last year
- InstaPY☆11Oct 7, 2022Updated 3 years ago
- ZFS Debian packages repository, used to build upstream zfs repo for Ubuntu 18, Debian 10 and later☆15Oct 16, 2023Updated 2 years ago
- Qwen LLM in the mac menu bar <3☆27Mar 12, 2025Updated last year
- Collection of postfix related tools☆16Nov 28, 2018Updated 7 years ago
- WebUI for managing llama-server sessions☆30Jun 20, 2026Updated 3 weeks ago
- The new CloudStats Agent☆11Aug 7, 2017Updated 8 years ago
- Xiaomi Mi Router 4A Gigabit Edition☆12May 7, 2023Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆15Apr 30, 2026Updated 2 months ago
- Dockerfiles for FreeSurfer☆13Apr 10, 2026Updated 3 months ago
- Nginx configuration file for opencart☆13Jul 12, 2014Updated 12 years ago
- Designed for Daily Use & a bit of Gaming. B460M/i5-10400F/RX5500XT☆10Nov 9, 2025Updated 8 months ago
- A playground for AI/ML Models☆22May 24, 2026Updated last month
- Auto-tuned launcher for GGUF models on llama.cpp / ik_llama.cpp — OpenAI-compatible server with multi-GPU tensor-split, MoE expert placem…☆252Updated this week
- WordPress to GRAV blog import plugin☆10Apr 22, 2019Updated 7 years ago
- Yet another ZFS on Linux port☆12May 8, 2019Updated 7 years ago
- Documenting pfSense installation on HP T630 thin client with an additional Realtek 2.5gb NIC☆17Feb 11, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A Valetudo Telegram Bot☆17Aug 6, 2022Updated 3 years ago
- Yet another frontend for LLM, written using .NET and WinUI 3☆11Sep 14, 2025Updated 10 months ago
- Beiwe is a smartphone-based digital phenotyping research platform.☆13Updated this week
- ☆20Feb 2, 2025Updated last year
- PHP Gift Registry☆14Dec 3, 2023Updated 2 years ago
- Automated enforcement of net-negative LOC, complexity constraints, and quality standards for Claude code☆47Jul 29, 2025Updated 11 months ago
- One-stop ZFS backup & replication solution (fork)☆34Updated this week