Unified KV-cache compression for LLM inference: 12 Python-native methods, Debian-tested isolated add-ons, Godzilla KVarN/TriAttention, exact Godzilla/Gigatoken profiles, CUDA weight sharing, and multi-GPU planning.
☆25Aug 3, 2026Updated last week
Alternatives and similar repositories for multi-turboquant
Users that are interested in multi-turboquant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- vLLM fork for Tesla V100 (SM70) — extends 1CatAI's AWQ support and adds GGUF support☆20Jun 20, 2026Updated last month
- LLM inference in C/C++☆64May 7, 2026Updated 3 months ago
- Object-storage-native KV cache for LLM inference & RL. Cross-restart, cross-conversation, cross-engine via shared S3 bucket.☆18Jul 27, 2026Updated 2 weeks ago
- LLM inference in C/C++☆35Apr 12, 2026Updated 3 months ago
- High-performance batched Top-K selection for CPU inference. Up to 80x faster than PyTorch, optimized for LLM sampling with AVX2 SIMD.☆18Mar 20, 2026Updated 4 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- DFlash vLLM for DGX Spark — Plug & Play Block-Diffusion Speculative Decoding☆54Jun 28, 2026Updated last month
- High-performance K-line (Candlestick) chart for React Native, powered by Skia. Smooth, customizable, and built for real trading apps.☆19Mar 20, 2026Updated 4 months ago
- ☆27Jul 19, 2026Updated 3 weeks ago
- This project uses artificial intelligence technology to analyze video. Recognize video and audio for fragmentation into multiple clip sce…☆11Oct 3, 2018Updated 7 years ago
- Manages tasks and persistent storage for AI agents — assigns work, tracks completion, and provides a shared key-value store with full-tex…☆37Jul 19, 2026Updated 3 weeks ago
- A simple NER implementation using a DistilBERT based model with ML.NET☆13May 6, 2021Updated 5 years ago
- Towards Robust Fact-Checking: A Multi-Agent System with Advanced Evidence Retrieval☆15Jun 24, 2025Updated last year
- Project used to generate ML.NET AutoML code for machine learning.☆11Jul 19, 2021Updated 5 years ago
- Universal Ethernet Direct Connect (UniEDC)☆32Apr 1, 2026Updated 4 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- AGI runtime for bounded recursive self-awareness. Attempting machine consciousness at the Gödel–Turing–Hofstadter Nexus.☆18Mar 24, 2026Updated 4 months ago
- SyzgyDB: An embeddable vector database in Go for efficient disk-based storage and similarity searches, supporting various distance metric…☆11Nov 1, 2024Updated last year
- Elasticsearch provider for Examine in Umbraco v8☆12Jan 15, 2024Updated 2 years ago
- Qwen LLM in the mac menu bar <3☆28Mar 12, 2025Updated last year
- Easily add searching to your apps☆14Aug 3, 2026Updated last week
- Zig implementation of Apache Arrow☆15Jun 14, 2026Updated last month
- ☆20Feb 2, 2025Updated last year
- CNTK implementation of Fully Convolutional Networks (FCN) with ResNet for semantic segmentation☆12Aug 18, 2017Updated 8 years ago
- ☆392Apr 16, 2026Updated 3 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A template for Zig projects☆15Apr 17, 2026Updated 3 months ago
- By transforming source code into a queryable Semantic Graph and a structured AST, this tool bridges the gap between "reading text" and "u…☆35Feb 6, 2026Updated 6 months ago
- An EXPERIMENTAL implementation of Stable Diffusion in .NET, ported from Python libraries by Huggingface☆15Oct 30, 2023Updated 2 years ago
- Scripts for training Qwen 2.5 VL with ms-swift and GRPO☆12Feb 27, 2025Updated last year
- DIY Atari 2600+ Cart☆11Feb 10, 2024Updated 2 years ago
- Enhance your Google account security with this comprehensive guide. It covers strong passwords, two-factor authentication, phishing preve…☆11Nov 21, 2024Updated last year
- Python application, generating parallel corpus for any language pairs, can be used for training nmt (Neural Machine Translation) systems☆12Dec 8, 2022Updated 3 years ago
- NDISPktScan is a plugin for the Volatility Framework. It parses the Ethernet packets stored by ndis.sys in Windows kernel space memory.☆12Oct 23, 2015Updated 10 years ago
- We want to create a dashboard (with knowledge graphs) to visualize the network node communication situation based on the firewall logs to…☆16Oct 26, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- RQL.NET is a resource query language for .NET intended for use with web apps. It provides a simple, hackable api for creating dynamic sql…☆13Aug 3, 2023Updated 3 years ago
- Application server inside haproxy☆10May 11, 2018Updated 8 years ago
- COVID-19 FAQ chatbot in python along with user interfce☆10Feb 2, 2024Updated 2 years ago
- A2A MCP Server is a lightweight Python bridge that lets Claude Desktop or any MCP client talk to A2A agents. It provides three tools: reg…☆21May 4, 2025Updated last year
- Arduino SIM5218E GPS Project☆11Mar 8, 2015Updated 11 years ago
- Extract SD (Automatic1111, ComfyUI) metadata from generated files in bulk, search and browse your prompts☆20Jul 31, 2026Updated last week
- Implementing Reinforcement Learning to find the best dialogue strategy for a conversation agent (chatbot) by searching for maximum award.☆13Jun 2, 2017Updated 9 years ago