Official code for HiLS-Attention
☆150Aug 13, 2026Updated 2 months ago
Alternatives and similar repositories for HiLS-Attention
Users that are interested in HiLS-Attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [NeurIPS 2026] Code for our resarch paper "SAS: Simple Attention Sparsification via End-to-End Optimization of Context Ranking"☆67Sep 14, 2026Updated last month
- https://arxiv.org/abs/2610.13990☆33Oct 15, 2026Updated last week
- Ulysses sequence-parallel all-to-all as a torch custom op, moved by the GPU copy engines into torch symmetric memory. Zero SM usage; 1.66…☆54Aug 25, 2026Updated last month
- Flash-GMM, a memory-efficient GPU kernel that unlocks GMM soft clustering at billion-scale☆25Sep 30, 2026Updated 3 weeks ago
- FA4-based Relative Attention Kernel developed by TML and Colfax☆18Sep 11, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Breakable CUDA graph capture for PyTorch - capture compatible regions as CUDA graphs while running incompatible operations eagerly betwee…☆29Oct 8, 2026Updated 2 weeks ago
- ☆431Updated this week
- ☆116Aug 5, 2026Updated 2 months ago
- Research work aimed at addressing the problem of modeling infinite-length context☆53Dec 18, 2025Updated 10 months ago
- ☆130Updated this week
- Efficient and unified implementations for TopK-based sparse attention☆41Jul 10, 2026Updated 3 months ago
- Code and reproducibility artifacts for reconstructing megakernel persistence with CUDA PDL☆24Aug 5, 2026Updated 2 months ago
- DeepSeek-V3.2-Exp DSA Warmup Lightning Indexer training operator based on tilelang☆52Nov 19, 2025Updated 11 months ago
- A practical way of learning Swizzle☆45Feb 3, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Triton kernels and PyTorch ops for Block Attention Residuals (AttnRes)☆90May 29, 2026Updated 4 months ago
- FlashKDA: high-performance Kimi Delta Attention kernels☆1,286Sep 1, 2026Updated last month
- Reference implementation and examples of the CuTe Layout representation and algebra.☆380Sep 30, 2026Updated 3 weeks ago
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆46Updated this week
- High performance RMSNorm Implement by using SM Core Storage(Registers and Shared Memory)☆31Jan 22, 2026Updated 9 months ago
- NCU-driven iterative optimization workflow for CUDA/CUTLASS/Triton/CuTe DSL kernels.☆25Apr 10, 2026Updated 6 months ago
- DeepStack: Facilitating Co-Design Exploration of 3D DRAM-Stacked Accelerators for Distributed LLM Inference. Includes the MICRO 2026 AE a…☆65Oct 5, 2026Updated 2 weeks ago
- Advancing Foundation GUI Agents with In-Context Demonstrations☆110Sep 1, 2026Updated last month
- Kwai Summary Attention☆62Aug 31, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code for the paper "Stack Attention: Improving the Ability of Transformers to Model Hierarchical Patterns"☆19Mar 15, 2024Updated 2 years ago
- a size profiler for cuda binary☆74Oct 3, 2026Updated 2 weeks ago
- MoonEP: A Perfectly Balanced Expert Parallelism Library via Dynamic Redundant Experts☆1,189Oct 12, 2026Updated last week
- Handwritten GEMM using Intel AMX (Advanced Matrix Extension)☆17Jan 11, 2025Updated last year
- DeeperGEMM: crazy optimized version☆85May 5, 2025Updated last year
- Qwen3.8-Flash-Next is the foundation model developed by Qwen Team, Alibaba Group.☆438Aug 27, 2026Updated last month
- DeepSelect: TopK kernels for DeepSeek Sparse Attention (DSA) and Samplers☆495Sep 30, 2026Updated 3 weeks ago
- Native Android app for Hyperliquid. DEX trading☆227Dec 30, 2025Updated 9 months ago
- Muon in Int8 Precision Made Possible☆20Jun 18, 2026Updated 4 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- High-performance LLM operator library built on TileLang.☆196Updated this week
- Modular Markdown-based audio skills for AI agents and developers, covering signal processing, synthesis, effects, analysis, and spatial a…☆22May 21, 2026Updated 5 months ago
- OSP-Next☆68Jun 22, 2026Updated 4 months ago
- ☆54May 19, 2025Updated last year
- Skills for writing tilelang and debugging with CUDA toolkits.☆146Updated this week
- Code for Pushdown Layers from our EMNLP 2023 paper☆29Dec 3, 2023Updated 2 years ago
- Implementation of "Scaling Latent Reasoning via Looped Language Models" aka LoopLM☆31Apr 28, 2026Updated 5 months ago