LLM inference in C/C++
☆17Oct 16, 2026Updated this week
Alternatives and similar repositories for llama.cpp
Users that are interested in llama.cpp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Roaring compressed bitmaps for Ruby☆17Oct 7, 2026Updated 2 weeks ago
- Graphic Devices for R based on NanoVG☆10Jun 15, 2018Updated 8 years ago
- Merged into the Amecs project: https://github.com/Siphalor/amecs☆15Feb 22, 2026Updated 7 months ago
- OpenATP is an open-source Python package providing a common interface for Automated Theorem Proving (ATP)☆30Oct 8, 2026Updated last week
- Reddit daily news☆14Sep 14, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- REPL is the best IDE☆15Jul 19, 2019Updated 7 years ago
- A cool demo web app to show Node.js, Raphaeljs, socket.io, Express.js, Mongoose and MongoDB integration☆13Apr 11, 2015Updated 11 years ago
- ☆116Updated this week
- A custom firmware for volca drum☆87Sep 11, 2026Updated last month
- AI powered Remote Control application for Siglent SDS 1000X-E series oscilloscopes☆43Updated this week
- Caching experts made model agnostic for llama. Drastically speeds up generation speed on MoE models that fully fit in the RAM but partial…☆29Aug 6, 2026Updated 2 months ago
- Scripts to launch an ethereum miner on boot with Systemd☆12Oct 7, 2016Updated 10 years ago
- The best model under 200B at near 10 token/s exact batch throughput on a single laptop CPU, with an automatic 8 GB RAM path. Native C, no…☆23Sep 9, 2026Updated last month
- RL agent using private and shared world models☆11Jun 12, 2023Updated 3 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- HTTP status code viewer for neovim☆12Oct 11, 2026Updated last week
- Run a 177B model (Qwen3.8-Flash-Next) on an 8 GB laptop GPU. Measured: 6.6 GiB VRAM, 47.8 GiB RAM, 34-35 tok/s. The n-gram table stays on…☆24Sep 1, 2026Updated last month
- Automatic, model-driven permission review for OpenCode☆34Sep 17, 2026Updated last month
- LLM inference in C/C++☆26Sep 17, 2026Updated last month
- ☆11Jan 12, 2013Updated 13 years ago
- It's all about setting limits for yourself.☆15Jul 20, 2013Updated 13 years ago
- Docker volume driver for Digital Ocean block storage☆10May 22, 2023Updated 3 years ago
- Rust bindings for CTranslate2☆14Jun 21, 2023Updated 3 years ago
- Python Scripts to enable advanced support for Novation Launckey MK3 models in FL Studio☆14Apr 24, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆27Sep 11, 2026Updated last month
- A controlled vocabulary of 429 Active Inference and Free Energy Principle terms, published as a structured, versioned source with determi…☆16Sep 1, 2026Updated last month
- LUMI containers - recipes and build/tests infrastructure.☆10Mar 18, 2025Updated last year
- WebDAV storage for carrierwave☆17Dec 30, 2019Updated 6 years ago
- A simple flat file photo gallery☆16Aug 20, 2014Updated 12 years ago
- A modular approach to WebGL programming☆20Feb 3, 2014Updated 12 years ago
- Julia implementation of flash-attention operation for neural networks.☆11May 31, 2023Updated 3 years ago
- openFrameworks / Lua examples for the EYESY☆18Jan 26, 2023Updated 3 years ago
- Stuff related to scraping the Code Review StackExchange☆11Jan 19, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Adds Directed Acyclic Graph Functionality to ActiveRecord☆19May 10, 2022Updated 4 years ago
- Getting Started with Jenkins (3rd Edition) course @Pluralsight☆11Jul 23, 2023Updated 3 years ago
- ☆20May 26, 2026Updated 4 months ago
- System-wide Lean input method☆13Feb 16, 2022Updated 4 years ago
- use some streams with your pouches☆21Mar 30, 2015Updated 11 years ago
- Re-usable low-level ML components☆11Oct 31, 2018Updated 7 years ago
- An AI Pair Programmer, that teaches you to code as you write, for Emacs☆26Jun 20, 2026Updated 4 months ago