turboquant-based compression engine for LLM KV cache
☆62Apr 3, 2026Updated 4 months ago
Alternatives and similar repositories for turboquant_cutile
Users that are interested in turboquant_cutile are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Repository for GPU related kernels for learning/testing purposes☆20May 27, 2026Updated 2 months ago
- ☆19Apr 26, 2026Updated 3 months ago
- Gumbel-Softmax post-training quantization for LLMs (1–3 bit scalar, INT/GGUF-compatible).☆20Jul 11, 2026Updated last month
- A codebase for pretraining multi-billion-scale sparse GPTs.☆27Feb 9, 2026Updated 6 months ago
- SpectralQuant: Calibrated Eigenbasis Rotation and Water-Filled Bit Allocation for KV-Cache Compression☆203May 15, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The official code for "Advancing Multimodal Large Language Models with Quantization-Aware Scale Learning for Efficient Adaptation" | [MM2…☆14Dec 7, 2024Updated last year
- A compact high-signal benchmark for evaluating frontier agents☆25Aug 3, 2026Updated 2 weeks ago
- Code repository for the SOSP'25 paper DCP: Addressing Input Dynamism In Long-Context Training via Dynamic Context Parallelism.☆22Nov 28, 2025Updated 8 months ago
- Write a fast kernel and see how you compare against the best humans and AI on gpumode.com☆110Jul 29, 2026Updated 2 weeks ago
- An N-gram punctuator for Chinese and English.☆20Oct 14, 2025Updated 10 months ago
- ☆42Updated this week
- a personal collection of my notes for ml sys☆120Aug 8, 2026Updated last week
- [MLSys 26] 🥇 Solution for Gated Delta Net Track of MLSys 26 Flash infer competition☆36May 22, 2026Updated 2 months ago
- 1bit llama.cpp gguf weights paired with turboquant 4 bit kv cache☆23Apr 4, 2026Updated 4 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆269Apr 5, 2026Updated 4 months ago
- Efficient Long-context Language Model Training by Core Attention Disaggregation☆105Apr 7, 2026Updated 4 months ago
- Training-free KV cache compression via E8 lattice VQ. 2-bit KV that preserves retrieval (30/30 NIAH vs TurboQuant 0/30). Calibration-free…☆25Aug 4, 2026Updated 2 weeks ago
- Region-level profiling for CUDA kernels with trace, NVBit, CUPTI, NSys, and an interactive Explorer.☆127Apr 17, 2026Updated 4 months ago
- Get a hack club dino☆12Mar 13, 2023Updated 3 years ago
- A list of active Hack Club open source repositories with available issues on GitHub☆16Jun 16, 2026Updated 2 months ago
- ☆394Apr 16, 2026Updated 4 months ago
- Code for the paper *Attention Drift: What Speculative Decoding Models Learn*.☆28May 12, 2026Updated 3 months ago
- Frontend for managing Hack as a Service apps☆14Mar 6, 2023Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- GPU kernel benchmarking☆47Jun 10, 2026Updated 2 months ago
- 一个普通的网站☆17May 18, 2025Updated last year
- Hack Club Bank CLI☆10Jul 25, 2022Updated 4 years ago
- Cellular Agent-based Modeling from a Clean Slate☆21Updated this week
- ⌨️ the simplest and smallest code editor for web, with no dependencies - forked from spell 🪄☆14Nov 5, 2025Updated 9 months ago
- Website for Hack Club's Moonbeam project☆14Apr 4, 2022Updated 4 years ago
- Next.js app to display the word count of given text.☆11Mar 5, 2023Updated 3 years ago
- A dynamic binary instrumentation tool for tracing and analyzing GPU kernel instructions.☆78Updated this week
- Sample Codes using NVSHMEM on Multi-GPU☆30Jan 22, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code for data-aware compression of DeepSeek models☆76Dec 11, 2025Updated 8 months ago
- This repo contains Lyra AI's work in the E-Commerce Hackathon organized by Trendyol and Teknofest.☆11Nov 6, 2024Updated last year
- One command · One Microsoft login · Zero repeated auth Hours of uninterrupted access to NYU Torch from your terminal and IDE.☆15Jul 17, 2026Updated last month
- 🗺 IB Computer Science data structures in JavaScript!☆17Nov 8, 2021Updated 4 years ago
- Some funny cute/cuteDSL code snippets☆33Mar 2, 2026Updated 5 months ago
- A Python DSL to write Nvidia PTX for Hopper and Blackwell in JAX and PyTorch☆374Jul 9, 2026Updated last month
- [NeurIPS 2025] ClusterFusion: Expanding Operator Fusion Scope for LLM Inference via Cluster-Level Collective Primitive☆75Aug 8, 2026Updated last week