Experimental LLM inference in C/C++
☆40May 15, 2026Updated 2 months ago
Alternatives and similar repositories for llama-cpp-turboquant
Users that are interested in llama-cpp-turboquant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- llama.cpp fork with TQ3_1S/4S CUDA kernels — 3.5-bit WHT quantization achieving Q4s quality at 10% smaller size. Based on RaBitQ-inspired…☆222Updated this week
- Pocket Flow: A minimalist LLM framework. Let Agents build Agents!☆16Jan 26, 2026Updated 6 months ago
- LLM inference in C/C++☆2,234Updated this week
- ☆12Feb 19, 2025Updated last year
- PWA built on Pi coding agent☆24Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- LLM inference in C/C++☆64May 7, 2026Updated 2 months ago
- KVarN, KV cache precision tail, low-bit quants in llama.cpp for longer context of better precision in the same VRAM☆833Updated this week
- A tooklit of custom nodes and utilites for ComfyUI - Including: "Final Frame Selector" and "Video Merge"☆41Dec 5, 2024Updated last year
- Automatic Detection of Potentially Idiomatic Expressions☆12Feb 19, 2021Updated 5 years ago
- Pricing and calibration models☆13Mar 28, 2025Updated last year
- Generate image and video creatives using Placid.app templates in MCP compatible hosts☆14Mar 28, 2025Updated last year
- Repository for TRACE: Capability-Targeted Agentic Training☆110Jul 12, 2026Updated 3 weeks ago
- Pi skill for multi-agent workflow orchestration with file-based handoff☆38Jan 18, 2026Updated 6 months ago
- ☆10Jul 6, 2023Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ComfyUI Nodes that integrate GLSL shader support.☆20Aug 25, 2025Updated 11 months ago
- Writing Observer and Learning Observer: A system for monitoring learning process data, with an initial focus on writing process data from…☆12Updated this week
- LTX-2 is the first DiT-based audio-video foundation model that contains all core capabilities of modern video generation in one model: sy…☆31May 13, 2026Updated 2 months ago
- Comprehensive Python Cheatsheet☆11Oct 12, 2022Updated 3 years ago
- ComfyUI Node wrapper of SunoAI API☆21Dec 17, 2024Updated last year
- Use spaCy for NLP and output to the FoLiA XML format.☆12Feb 27, 2024Updated 2 years ago
- An Android library that provides a Jetpack Compose wrapper on top of the Google Wallet button assets.☆15May 9, 2023Updated 3 years ago
- ☆11Nov 14, 2021Updated 4 years ago
- PuLID for Flux☆60Jun 29, 2026Updated last month
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Fused TBQ4 Flash Attention + MTP + Shared Tensors for llama.cpp — 82+ tok/s with lossless 4.25 bpv KV cache at 200K context on RTX 4090☆91Updated this week
- API Wrapper for the FINRA Query API☆12Jul 11, 2023Updated 3 years ago
- Just a Haskell wrapper for OpenAI API calls☆11Mar 2, 2023Updated 3 years ago
- ☆11Jun 8, 2024Updated 2 years ago
- Near-optimal vector quantization from Google's ICLR 2026 paper — 95% recall, 5x compression, zero preprocessing, pure Python FAISS replac…☆20Mar 28, 2026Updated 4 months ago
- ☆16Jun 15, 2026Updated last month
- ☆25Jun 12, 2026Updated last month
- ☆11Mar 31, 2023Updated 3 years ago
- ☆15Jul 23, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆11Nov 21, 2022Updated 3 years ago
- Coqui STT (🐸STT) based forced alignment tool☆13Feb 24, 2022Updated 4 years ago
- Run Pine Script® indicators and strategies from your terminal. Point it at any .pine file and get JSON output — live market data or your …☆18Jul 24, 2026Updated last week
- Code repository for Computer Vision Projects with Python 3, Published By Packt☆14Jan 15, 2021Updated 5 years ago
- Twitter Dataset and Finetuned Transformer Model for Turkish Sentiment Analysis☆14Jul 29, 2022Updated 4 years ago
- A wiki designed for both humans and agents to read and write.☆68Updated this week
- ☆10Jul 29, 2020Updated 6 years ago