Unified KV-cache compression for LLM inference: 12 Python-native methods, guarded add-on composition and routing, analytical capacity simulation, Godzilla KVarN/TriAttention with SM86/SM89 qualification, CUDA weight sharing, and multi-GPU planning.
☆28Aug 22, 2026Updated last month
Alternatives and similar repositories for multi-turboquant
Users that are interested in multi-turboquant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Run Qwen3.5-35B-A3B with 1 million token context on a single NVIDIA L4☆29Apr 9, 2026Updated 6 months ago
- ☆41Mar 31, 2026Updated 6 months ago
- LLM inference in C/C++☆64May 7, 2026Updated 5 months ago
- Some useful scripts to install common softwares☆10Jul 4, 2019Updated 7 years ago
- LLM inference in C/C++☆35Aug 24, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Open format for specifying structured assumptions and requirements about code.☆95Sep 11, 2026Updated last month
- ☆16Jun 3, 2026Updated 4 months ago
- High-performance batched Top-K selection for CPU inference. Up to 80x faster than PyTorch, optimized for LLM sampling with AVX2 SIMD.☆18Mar 20, 2026Updated 6 months ago
- Installable NumPy reference package, experiment archive, and development scaffold for Dendritrons.☆28Jul 19, 2026Updated 2 months ago
- JavaScript component to parse, clean, remove formatting (unformat) numbers in strings.☆10Dec 5, 2024Updated last year
- Dispatch AI coding agents (Claude Code, Copilot, OpenCode) as MCP tools☆22Apr 8, 2026Updated 6 months ago
- Implementation for IceCache: Memory-Efficient KV-cache Management for Long-Sequence LLMs (ICLR 2026).☆25Jun 9, 2026Updated 4 months ago
- Manages tasks and persistent storage for AI agents — assigns work, tracks completion, and provides a shared key-value store with full-tex…☆38Oct 4, 2026Updated last week
- SERP Scraping API code examples for Python, PHP and Node.js☆21Nov 26, 2025Updated 10 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A simple NER implementation using a DistilBERT based model with ML.NET☆13May 6, 2021Updated 5 years ago
- Tiny evaluation of leading LLMs on competitive programming problems☆14Apr 10, 2026Updated 6 months ago
- TurboDB — a blazing-fast NoSQL document database written in Zig. mmap + WAL + B-tree + MVCC.☆21May 1, 2026Updated 5 months ago
- ☆16May 10, 2026Updated 5 months ago
- Fody AddIn that allows declarative padding structures and classes to fight the false sharing problem.☆12May 24, 2016Updated 10 years ago
- Project used to generate ML.NET AutoML code for machine learning.☆11Jul 19, 2021Updated 5 years ago
- This includes 2 separate tutorial series for OpenAI swarm library each 10 files from basic to advanced☆14Jan 14, 2025Updated last year
- Elasticsearch provider for Examine in Umbraco v8☆12Jan 15, 2024Updated 2 years ago
- SyzgyDB: An embeddable vector database in Go for efficient disk-based storage and similarity searches, supporting various distance metric…☆11Nov 1, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Starter template for using Better Auth with Tanstack Start - includes Drizzle ORM and sqlite DB.☆22Nov 6, 2025Updated 11 months ago
- ☆19Mar 9, 2021Updated 5 years ago
- This is my speaker recognition implementation based on the x-vector system described in "X-Vectors: Robust DNN Embeddings for Speaker Rec…☆11Jul 23, 2026Updated 2 months ago
- Easily add searching to your apps☆14Updated this week
- Zig implementation of Apache Arrow☆19Jun 14, 2026Updated 3 months ago
- ☆21Feb 2, 2025Updated last year
- ☆15Feb 15, 2017Updated 9 years ago
- ☆397Apr 16, 2026Updated 5 months ago
- A template for Zig projects☆15Apr 17, 2026Updated 5 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- 微信公众号：机器感知 | Tracking the Latest Layer Diffusion Trending☆21Dec 1, 2024Updated last year
- An EXPERIMENTAL implementation of Stable Diffusion in .NET, ported from Python libraries by Huggingface☆15Oct 30, 2023Updated 2 years ago
- 面向图形、图像、语音、视频、AI、RPA、生物医药计算的高性能脚本语言☆16Jun 18, 2022Updated 4 years ago
- Python application, generating parallel corpus for any language pairs, can be used for training nmt (Neural Machine Translation) systems☆12Dec 8, 2022Updated 3 years ago
- NDISPktScan is a plugin for the Volatility Framework. It parses the Ethernet packets stored by ndis.sys in Windows kernel space memory.☆12Oct 23, 2015Updated 10 years ago
- RQL.NET is a resource query language for .NET intended for use with web apps. It provides a simple, hackable api for creating dynamic sql…☆13Aug 3, 2023Updated 3 years ago
- Simple PHP script that parses a public amazon whishlist and export the items to a CSV file.☆13Jun 19, 2016Updated 10 years ago