Efficient Mask-Aware Distributed Attention for Long-Context Training
☆50Oct 16, 2026Updated this week
Alternatives and similar repositories for FlashMask
Users that are interested in FlashMask are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- NaiveRT: a self-contained TP8 inference runtime for the Naive N series on eight Blackwell GPUs with UMMA support. One persistent CUDA gra…☆30Sep 27, 2026Updated 3 weeks ago
- Dist-MoE implements Speed-of-Light distributed Mixture-of-Experts forward and backward kernels. They are highly optimized and fused comm-…☆17Updated this week
- ☆57Sep 27, 2026Updated 3 weeks ago
- A linker for partial GPU kernels.☆28Oct 12, 2026Updated last week
- ☆32Jul 2, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- An open, visual atlas of looped transformers, recurrent computation, adaptive depth, and latent reasoning.☆33Sep 26, 2026Updated 3 weeks ago
- Ulysses sequence-parallel all-to-all as a torch custom op, moved by the GPU copy engines into torch symmetric memory. Zero SM usage; 1.66…☆54Aug 25, 2026Updated last month
- NCCL communication API layer, and transport layer created from first principles.☆16Aug 20, 2025Updated last year
- Database write ahead log in Rust.☆21Mar 15, 2025Updated last year
- Fast and memory-efficient exact attention☆22Sep 10, 2026Updated last month
- A rust based risc-v operating system!☆11Feb 12, 2026Updated 8 months ago
- https://arxiv.org/abs/2610.13990☆30Updated this week
- ☆26Feb 27, 2026Updated 7 months ago
- An open-source toolkit for BigMac-style pipeline-parallel training of multimodal large language models.☆37Jul 21, 2026Updated 3 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Winner 🏆 (Agent-only) MLSys 2026 - FlashInfer AI Kernel Generation Contest for the DeepSeek Sparse Attention (DSA) track with an average…☆317Sep 12, 2026Updated last month
- FreeCAD 3D CAD automation via FastMCP — headless document/export plus FluidX3D/OpenFOAM CFD extensions. For Cursor / Claude Desktop. Weba…☆32Oct 13, 2026Updated last week
- 一个包含地球上所有能唱的歌的免费KTV☆137Updated this week
- ☆68Feb 24, 2026Updated 7 months ago
- Curated high-performance TIRx GPU kernels☆32Updated this week
- DeepSelect: TopK kernels for DeepSeek Sparse Attention (DSA) and Samplers☆495Sep 30, 2026Updated 3 weeks ago
- ☆52Jul 27, 2026Updated 2 months ago
- ☆12Nov 21, 2025Updated 11 months ago
- UIUC CS241 MPs and Labs☆11Jan 2, 2020Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- High Concurrency Bloom Filter Implementations for Go☆12Oct 10, 2023Updated 3 years ago
- 本人自用的SDK☆14Sep 11, 2026Updated last month
- Priority scheduling, Priority donation and Alarm clock in Pintos.☆10Jun 23, 2019Updated 7 years ago
- Some funny cute/cuteDSL code snippets☆35Mar 2, 2026Updated 7 months ago
- Sample Codes using NVSHMEM on Multi-GPU☆30Jan 22, 2023Updated 3 years ago
- a simple API to use CUPTI☆10Aug 19, 2025Updated last year
- GPU Functional Descriptor for memory access☆35May 24, 2026Updated 4 months ago
- ☆16Jan 18, 2025Updated last year
- 알고리즘 정리☆11Apr 18, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A hobby fully-functioning Operating System for learning purposes☆10Mar 13, 2024Updated 2 years ago
- Rust implementation of the Drain log-mining algorithm (He et al., 2017) - with the practical extensions Drain3 popularized (masks, persis…☆20Jun 28, 2026Updated 3 months ago
- Region-level profiling for CUDA kernels with trace, NVBit, CUPTI, NSys, and an interactive Explorer.☆133Apr 17, 2026Updated 6 months ago
- A scheduling framework for multitasking over diverse XPUs, including GPUs, NPUs, ASICs, and FPGAs☆14Jun 17, 2026Updated 4 months ago
- What makes Viewstamped Replication tick?☆15Nov 30, 2023Updated 2 years ago
- ☆81Updated this week
- A fault-tolerant distributed message queue system inspired by Kafka, with priority messaging, replication, and real-time monitoring.☆14Aug 15, 2025Updated last year