LLM inference in C/C++
☆31Mar 28, 2026Updated 3 months ago
Alternatives and similar repositories for llama.cpp
Users that are interested in llama.cpp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Open source library for N64 development.☆32May 18, 2026Updated last month
- A list of Game Development resources to make magic happen.☆30May 18, 2026Updated last month
- A list of open source games.☆30Mar 26, 2026Updated 3 months ago
- ☆30Jul 5, 2026Updated last week
- Elyan Labs — Hartford AI Day Pitch Deck☆31Jun 10, 2026Updated last month
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Tensors and Dynamic neural networks in Python with strong GPU acceleration☆25Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆34Jul 9, 2026Updated last week
- TLS/SSL and crypto library☆32Mar 16, 2026Updated 4 months ago
- The wolfSSL library is a small, fast, portable implementation of TLS/SSL for embedded devices to the cloud. wolfSSL supports up to TLS 1…☆33May 18, 2026Updated last month
- RPI (Resonant Permutation Inference) — Zero-multiply text generation. 18K tok/s. 868 KB models. Standalone or as speculative draft engine…☆38Jul 2, 2026Updated 2 weeks ago
- Samples for CUDA Developers which demonstrates features in CUDA Toolkit☆30May 15, 2026Updated 2 months ago
- Capstone disassembly/disassembler framework for ARM, ARM64 (ARMv8), Alpha, BPF, Ethereum VM, HPPA, LoongArch, M68K, M680X, Mips, MOS65XX,…☆32Apr 3, 2026Updated 3 months ago
- ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator☆27Apr 12, 2026Updated 3 months ago
- The definitive list of lists (of lists) curated on GitHub and elsewhere☆29Mar 21, 2026Updated 3 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A collection of free software and free culture resources for making amazing games. (mirror)☆32Mar 26, 2026Updated 3 months ago
- A curated list of modern Generative Artificial Intelligence projects and services☆33Mar 26, 2026Updated 3 months ago
- ☆39May 18, 2026Updated last month
- A curated list of awesome C++ (or C) frameworks, libraries, resources, and shiny things. Inspired by awesome-... stuff.☆32Mar 28, 2026Updated 3 months ago
- A curated list of awesome Machine Learning frameworks, libraries and software.☆33May 18, 2026Updated last month
- Collection of Games that have the source code available on GitHub☆35May 18, 2026Updated last month
- Mine RTC while playing retro games on Raspberry Pi. RetroAchievements integration, Proof of Play, Cartridge Relics, Saturday Morning Ques…☆36Jun 12, 2026Updated last month
- Access to Anthropic's safety-first language model APIs in TypeScript☆36Jun 20, 2026Updated 3 weeks ago
- ☆33May 18, 2026Updated last month
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A fast, compressed, persistent binary data store library for C.☆34May 18, 2026Updated last month
- Météo-France's AI Python package☆40May 18, 2026Updated last month
- A marketplace for AI-assisted engineers and skilled workers.☆24May 18, 2026Updated last month
- A curated list of edge tools for AI applications☆32Mar 26, 2026Updated 3 months ago
- Awesome-LLM: a curated list of Large Language Model☆32May 18, 2026Updated last month
- Awesome list of open-source startup alternatives to well-known SaaS products 🚀☆33May 18, 2026Updated last month
- openpilot is an operating system for robotics. Currently, it upgrades the driver assistance system on 300+ supported cars.☆35Mar 11, 2026Updated 4 months ago
- A carefully curated collection of high-quality libraries, projects, tutorials, research papers, and other essential resources focused on …☆33May 18, 2026Updated last month
- The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.☆37Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- DOSBox Staging is a modern continuation of DOSBox with advanced features and current development practices.☆25May 18, 2026Updated last month
- The Linux perf GUI for performance analysis.☆31Mar 18, 2026Updated 3 months ago
- Edge AI SCADA for hydroponic crop monitoring — Gemma 4 function calling on NFT systems. Kaggle competition entry.☆34Jul 5, 2026Updated last week
- A curated list of Artificial Intelligence Top Tools☆41Apr 28, 2026Updated 2 months ago
- A curated list of AI video generation tools - text-to-video, avatars, UGC ads, lip sync, and open source models.☆40Apr 28, 2026Updated 2 months ago
- A lightweight sandboxing tool for enforcing filesystem and network restrictions on arbitrary processes at the OS level, without requiring…☆24Jul 5, 2026Updated last week
- Heavily optimized library for DEFLATE/zlib/gzip compression and decompression☆34Mar 16, 2026Updated 4 months ago