Official code for HiLS-Attention
☆153Aug 13, 2026Updated 2 months ago
Alternatives and similar repositories for HiLS-Attention
Users that are interested in HiLS-Attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [NeurIPS 2026] Code for our resarch paper "SAS: Simple Attention Sparsification via End-to-End Optimization of Context Ranking"☆69Sep 14, 2026Updated last month
- ☆11May 21, 2026Updated 5 months ago
- ☆20Updated this week
- Research work aimed at addressing the problem of modeling infinite-length context☆53Dec 18, 2025Updated 10 months ago
- https://arxiv.org/abs/2610.13990☆36Oct 15, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆437Oct 31, 2026Updated last week
- FA4-based Relative Attention Kernel developed by TML and Colfax☆18Sep 11, 2026Updated 2 months ago
- Ulysses sequence-parallel all-to-all as a torch custom op, moved by the GPU copy engines into torch symmetric memory. Zero SM usage; 1.66…☆55Aug 25, 2026Updated 2 months ago
- FlashMemory DS-V4 Retriever: a lightweight retriever that sparsifies DeepSeek-V4 CSA KV-cache. Weights available on Hugging Face.☆111Jul 18, 2026Updated 3 months ago
- Official repository Flash Local Linear Attention☆40May 28, 2026Updated 5 months ago
- DashAttention: Differentiable and Adaptive Sparse Hierarchical Attention☆25May 25, 2026Updated 5 months ago
- Advancing Foundation GUI Agents with In-Context Demonstrations☆117Sep 1, 2026Updated 2 months ago
- a size profiler for cuda binary☆74Oct 3, 2026Updated last month
- DeepSeek-V3.2-Exp DSA Warmup Lightning Indexer training operator based on tilelang☆52Nov 19, 2025Updated 11 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A practical way of learning Swizzle☆45Feb 3, 2025Updated last year
- ☆255Nov 19, 2025Updated 11 months ago
- FlashKDA: high-performance Kimi Delta Attention kernels☆1,297Oct 26, 2026Updated 2 weeks ago
- Sparse Decoupled Attention for Efficient Long-Context LLM Inference☆74Jun 4, 2026Updated 5 months ago
- Triton kernels and PyTorch ops for Block Attention Residuals (AttnRes)☆91May 29, 2026Updated 5 months ago
- Code and reproducibility artifacts for reconstructing megakernel persistence with CUDA PDL☆27Aug 5, 2026Updated 3 months ago
- [ICML 2026] NITP: Next Implicit Token Prediction for LLM Pre-training☆36May 26, 2026Updated 5 months ago
- Staleness-Adaptive Trust Region (SAT), a directional, token-adaptive clipping method for stabilizing asynchronous reinforcement learning …☆24Jul 22, 2026Updated 3 months ago
- Flash-GMM, a memory-efficient GPU kernel that unlocks GMM soft clustering at billion-scale☆25Sep 30, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- High-performance LLM operator library built on TileLang.☆203Updated this week
- High performance RMSNorm Implement by using SM Core Storage(Registers and Shared Memory)☆31Jan 22, 2026Updated 9 months ago
- Quantized Attention on GPU☆45Nov 22, 2024Updated last year
- Kwai Summary Attention☆63Updated this week
- Code for the paper "Stack Attention: Improving the Ability of Transformers to Model Hierarchical Patterns"☆19Mar 15, 2024Updated 2 years ago
- DeeperGEMM: crazy optimized version☆85May 5, 2025Updated last year
- 🐳 Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"☆1,027Feb 5, 2026Updated 9 months ago
- NCU-driven iterative optimization workflow for CUDA/CUTLASS/Triton/CuTe DSL kernels.☆25Apr 10, 2026Updated 7 months ago
- ☆16Sep 13, 2026Updated last month
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Block-GTQ: RoPE-aware bit allocation for KV-cache quantization☆17Oct 29, 2026Updated 2 weeks ago
- ☆27Jul 13, 2026Updated 3 months ago
- Handwritten GEMM using Intel AMX (Advanced Matrix Extension)☆17Jan 11, 2025Updated last year
- Minimal agent harness in one Bash file. One-line quick start. Bootloader agent for bare-metal servers.☆23Sep 15, 2026Updated last month
- Accelerate LLM preference tuning via prefix sharing with a single line of code☆52Jul 4, 2025Updated last year
- Muon in Int8 Precision Made Possible☆21Updated this week
- [ICML 2026] Prism: Spectral-Aware Block-Sparse Attention☆27May 22, 2026Updated 5 months ago
Are these results useful?