LLM inference in C/C++
☆12Oct 18, 2026Updated last week
Alternatives and similar repositories for llama.cpp
Users that are interested in llama.cpp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A CUDA-accelerated GGUF quantization tool for NVFP4/MXFP6/Q_K, utilizing layer by layer quantization and selection techniques to reduce e…☆49Aug 15, 2026Updated 2 months ago
- benchmarks for LLM tokenizers☆22Mar 25, 2026Updated 7 months ago
- Solves ComfyUI's inherent RAM bottleneck where videos are converted to uncompressed 32-bit float tensors (~24MB per frame for 1080p), cau…☆15Jan 8, 2026Updated 9 months ago
- ☆13May 1, 2023Updated 3 years ago
- A translator based on text generation webui allow you use local language model to translate epub book☆16Jun 11, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆10Feb 22, 2026Updated 8 months ago
- A generator creating boostraps☆12Mar 20, 2012Updated 14 years ago
- Official Atlas Spark recipe registry for sparkrun (@atlas namespace) — Qwen3.5/3-Next, Gemma-4, Nemotron-3, Mistral-Small-4, MiniMax-M2.7…☆19Sep 23, 2026Updated last month
- Custom Gemma 4 chat template for llama.cpp/OpenWebUI that preserves tool-calling behavior while preventing thinking-channel (<|channel>th…☆13Apr 11, 2026Updated 6 months ago
- A python2 script for detecting "Dash" button presses and firing Home-Assistant event triggers☆11Dec 2, 2015Updated 10 years ago
- MCP memory server using SQLite + FTS5 + sqlite-vec☆13Jun 12, 2026Updated 4 months ago
- The l4t linux kernel☆10Dec 5, 2018Updated 7 years ago
- This is the original matlab version of MKCFup☆10Jan 23, 2019Updated 7 years ago
- detect face using MTCNN and tracking face with KCF/Kalman Filter. The assignment problem solved by Hungarian.☆12Nov 16, 2019Updated 6 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ff-rknn - Real-time Object Detection with NPU (Rockchip)☆15Sep 5, 2023Updated 3 years ago
- vlt - A secure command-line tool for managing secrets in your terminal.☆16Oct 21, 2026Updated last week
- ☆11Oct 22, 2026Updated last week
- 基于VGG16网络提取图像特征做图像检索提供Restful接口demo☆16Dec 2, 2019Updated 6 years ago
- ☆16Updated this week
- Implementation of various methods of single / multi object tracking 🐾🛰☆10Jan 24, 2020Updated 6 years ago
- YOLOv8 on Orange Pi 5 or similar RK3588 platforms.☆13Nov 30, 2024Updated last year
- ☆14Oct 16, 2017Updated 9 years ago
- An AI-based story writer and Python library which uses OpenAI's chatGPT and Dall-E to generate PDFs with a story and a picture from a pro…☆24Feb 23, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ffmpeg-drm RK3588☆13Jul 17, 2023Updated 3 years ago
- A powerful, adaptive system optimizer that automatically generates optimized kernel parameters for Linux systems. This tool detects your …☆14Oct 18, 2025Updated last year
- Reinforcement Learning (RL) is believe to be a more general approach towards Artificial Intelligence (AI). RL is the foundation for many …☆14Dec 22, 2022Updated 3 years ago
- Config files for various CSI2 devices☆13Mar 27, 2021Updated 5 years ago
- Приложение для скачивания книг с сайта LitRes.ru по подписке.☆25Oct 2, 2026Updated 3 weeks ago
- scripts for deploying Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled☆17Mar 31, 2026Updated 6 months ago
- WebSocket聊天室☆25Sep 3, 2017Updated 9 years ago
- Please use `radxa-a733` image☆15Sep 8, 2025Updated last year
- A simple framework for using a local Koboldcpp LLM to help with story-writing☆24Nov 26, 2023Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- An Agent Skill kit for developing Godot games without opening the Godot editor☆15Apr 26, 2026Updated 6 months ago
- Python implementation of KCF tracking algorithm with Convolutional Networks in Theano and Caffe☆16Feb 10, 2017Updated 9 years ago
- 🍡 30x faster tokenization for every HuggingFace model☆55Oct 23, 2026Updated last week
- Generate images locally with Bonsai 1-bit and ternary image generation models.☆30Jun 12, 2026Updated 4 months ago
- Mods for Oxygen Not Included☆32Jun 20, 2026Updated 4 months ago
- Modular telegram group management bot, used for the Python Italia telegram group☆20Jun 29, 2026Updated 4 months ago
- Here lies my university course project☆14May 26, 2022Updated 4 years ago