Block-GTQ: RoPE-aware bit allocation for KV-cache quantization
☆15Jun 24, 2026Updated 4 months ago
Alternatives and similar repositories for blockgtq
Users that are interested in blockgtq are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- High-performance tokenization for inference☆14Updated this week
- ☆15Jul 10, 2026Updated 3 months ago
- CUDA Graph runtime tensor debugging utilities for PyTorch☆18Jul 12, 2026Updated 3 months ago
- Efficient and unified implementations for TopK-based sparse attention☆41Jul 10, 2026Updated 3 months ago
- Models Take Notes at Prefill: KV Cache Can Be Editable and Composable (arXiv:2606.17107) — paper, code, results, and interactive companio…☆16Jun 29, 2026Updated 3 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆39Aug 4, 2026Updated 2 months ago
- Flash-GMM, a memory-efficient GPU kernel that unlocks GMM soft clustering at billion-scale☆25Sep 30, 2026Updated 3 weeks ago
- ☆37Aug 7, 2025Updated last year
- [ICML 2025] CommVQ: Commutative Vector Quantization for KV Cache Compression☆27Sep 2, 2025Updated last year
- FA4-based Relative Attention Kernel developed by TML and Colfax☆18Sep 11, 2026Updated last month
- Debug print operator for cudagraph debugging☆18Aug 2, 2024Updated 2 years ago
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆47Updated this week
- 🔥 [ICML'26] ParisKV: Fast and Drift-Robust KV-Cache Retrieval for Long-Context LLMs☆37Aug 14, 2026Updated 2 months ago
- Official implementation of "SentenceKV: Efficient LLM Inference via Sentence-Level Semantic KV Caching" (COLM 2025). A novel KV cache com…☆15Sep 29, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Modular Markdown-based audio skills for AI agents and developers, covering signal processing, synthesis, effects, analysis, and spatial a…☆22May 21, 2026Updated 5 months ago
- Source codes for paper "BlockFFN: Towards End-Side Acceleration-Friendly Mixture-of-Experts with Chunk-Level Activation Sparsity".☆19Jan 10, 2026Updated 9 months ago
- DeeperGEMM: crazy optimized version☆85May 5, 2025Updated last year
- Muon in Int8 Precision Made Possible☆20Jun 18, 2026Updated 4 months ago
- VP-VLA: Visual Prompting as an Interface for Vision-Language-Action Models☆26Apr 12, 2026Updated 6 months ago
- ☆41Sep 2, 2026Updated last month
- ☆132Updated this week
- ☆19Aug 16, 2025Updated last year
- DeepSeek-V3.2-Exp DSA Warmup Lightning Indexer training operator based on tilelang☆52Nov 19, 2025Updated 11 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- A linker for partial GPU kernels.☆32Oct 12, 2026Updated last week
- ☆22Jun 3, 2026Updated 4 months ago
- Efficient Long-context Language Model Training by Core Attention Disaggregation☆106Apr 7, 2026Updated 6 months ago
- ☆22Jul 13, 2026Updated 3 months ago
- ☆58Sep 18, 2025Updated last year
- ☆26Jun 10, 2026Updated 4 months ago
- Repo for ECHO: Efficient KV Cache Offloading with Lossless Prefetching for Serving Native Sparse Attention LLMs (OSDI'26)☆39Jul 12, 2026Updated 3 months ago
- This project is the official implementation of 'DreamOmni3: Scribble-based Editing and Generation''☆41Aug 8, 2026Updated 2 months ago
- [TCSVT2026] The official repository of the paper "Contending with Depth Ambiguity in Monocular 3D Pose Estimation via Multi-Hypothesis Mo…☆13Oct 2, 2026Updated 3 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ⚒️ Your go-to resource for building Web3 applications. Curated tools, protocols, and tech stacks to streamline decentralized development☆11Nov 14, 2024Updated last year
- High performance RMSNorm Implement by using SM Core Storage(Registers and Shared Memory)☆31Jan 22, 2026Updated 9 months ago
- Trust metadata for AI agents — a stamp costs ~15 tokens, re-verifying costs 15,000. Agents stamp what they verify; the next agent runs 'a…☆19Updated this week
- Open source community's implementation of the model from "LANGUAGE MODEL BEATS DIFFUSION — TOKENIZER IS KEY TO VISUAL GENERATION"☆16Nov 11, 2024Updated last year
- a size profiler for cuda binary☆74Oct 3, 2026Updated 3 weeks ago
- A random kitten generator.☆10Oct 24, 2021Updated 5 years ago
- ☆15Dec 15, 2025Updated 10 months ago