Block-GTQ: RoPE-aware bit allocation for KV-cache quantization
☆17Oct 29, 2026Updated 2 weeks ago
Alternatives and similar repositories for blockgtq
Users that are interested in blockgtq are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [NeurIPS 2026] CoDMD: Copula-aware Distribution Matching Distillation for Fast Video Generation☆19Nov 5, 2026Updated last week
- ☆12Jun 2, 2026Updated 5 months ago
- ☆15Jul 10, 2026Updated 4 months ago
- ☆37Aug 7, 2025Updated last year
- [ICML 2025] CommVQ: Commutative Vector Quantization for KV Cache Compression☆27Sep 2, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- CUDA Graph runtime tensor debugging utilities for PyTorch☆18Jul 12, 2026Updated 4 months ago
- FA4-based Relative Attention Kernel developed by TML and Colfax☆18Sep 11, 2026Updated 2 months ago
- Efficient and unified implementations for TopK-based sparse attention☆41Jul 10, 2026Updated 4 months ago
- ☆41Nov 3, 2026Updated last week
- Debug print operator for cudagraph debugging☆18Aug 2, 2024Updated 2 years ago
- Models Take Notes at Prefill: KV Cache Can Be Editable and Composable (arXiv:2606.17107) — paper, code, results, and interactive companio…☆16Updated this week
- Official implementation of "SentenceKV: Efficient LLM Inference via Sentence-Level Semantic KV Caching" (COLM 2025). A novel KV cache com…☆15Sep 29, 2025Updated last year
- [MLSys 2026] Official code of SkipKV: Selectively Skip KV Generation and Storage for Efficient Inference with Large Reasoning Models.☆16Oct 26, 2026Updated 2 weeks ago
- 🔥 [ICML'26] ParisKV: Fast and Drift-Robust KV-Cache Retrieval for Long-Context LLMs☆37Aug 14, 2026Updated 3 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Source codes for paper "BlockFFN: Towards End-Side Acceleration-Friendly Mixture-of-Experts with Chunk-Level Activation Sparsity".☆19Jan 10, 2026Updated 10 months ago
- DeeperGEMM: crazy optimized version☆85May 5, 2025Updated last year
- Algorithm-System Co-design: accurate and efficient 2-bit KV cache quantization for LLM Inference.☆25May 20, 2026Updated 5 months ago
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆47Updated this week
- Official implementation of STaR-KV: training-free spatio-temporal KV cache compression for efficient GUI vision-language models.☆22Oct 17, 2026Updated 3 weeks ago
- VP-VLA: Visual Prompting as an Interface for Vision-Language-Action Models☆26Apr 12, 2026Updated 7 months ago
- ☆14Jan 23, 2026Updated 9 months ago
- Modular Markdown-based audio skills for AI agents and developers, covering signal processing, synthesis, effects, analysis, and spatial a…☆24May 21, 2026Updated 5 months ago
- DeepSeek-V3.2-Exp DSA Warmup Lightning Indexer training operator based on tilelang☆52Nov 19, 2025Updated 11 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Efficient Long-context Language Model Training by Core Attention Disaggregation☆107Apr 7, 2026Updated 7 months ago
- ☆19Aug 16, 2025Updated last year
- ☆24Updated this week
- ☆41Sep 2, 2026Updated 2 months ago
- High performance RMSNorm Implement by using SM Core Storage(Registers and Shared Memory)☆31Jan 22, 2026Updated 9 months ago
- ☆58Sep 18, 2025Updated last year
- a size profiler for cuda binary☆74Oct 3, 2026Updated last month
- Open source community's implementation of the model from "LANGUAGE MODEL BEATS DIFFUSION — TOKENIZER IS KEY TO VISUAL GENERATION"☆16Nov 11, 2024Updated 2 years ago
- A random kitten generator.☆10Oct 24, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Open ML Compiler Foundation for the Agentic Era☆95Updated this week
- A Postgres Extension to Manage Extensions! (As well as some random stuff)☆15May 31, 2023Updated 3 years ago
- ☆32Jul 2, 2025Updated last year
- An experimental communicating attention kernel based on DeepEP.☆34Jul 29, 2025Updated last year
- Official implementation of the paper "Length Value Model: Pretraining Value Model for Scalable Length Prediction and Control"☆13May 27, 2026Updated 5 months ago
- ☆146Updated this week
- [TCSVT2026] The official repository of the paper "Contending with Depth Ambiguity in Monocular 3D Pose Estimation via Multi-Hypothesis Mo…☆13Oct 2, 2026Updated last month
Are these results useful?