Efficient Mask-Aware Distributed Attention for Long-Context Training
☆62Nov 9, 2026Updated this week
Alternatives and similar repositories for FlashMask
Users that are interested in FlashMask are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- large language model internal-medicine monitor toolbox☆17Oct 28, 2026Updated 2 weeks ago
- A cross-node expert-parallel MoE training library for computation-communication overlap.☆16Updated this week
- ☆11Oct 29, 2026Updated last week
- Flash-Flash KDA: H100-optimized Flash Kimi Delta Attention kernels☆24Jul 24, 2026Updated 3 months ago
- Dist-MoE implements Speed-of-Light distributed Mixture-of-Experts forward and backward kernels. They are highly optimized and fused comm-…☆73Oct 29, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- PaddlePaddle Code Convert Toolkit. 『飞桨』深度学习代码转换工具☆123Aug 17, 2026Updated 2 months ago
- ☆18Jun 19, 2026Updated 4 months ago
- ☆32Jul 2, 2025Updated last year
- ☆27Feb 27, 2026Updated 8 months ago
- ☆20Nov 22, 2025Updated 11 months ago
- PaddlePaddle Developer Community☆145Nov 4, 2026Updated last week
- An efficient implementation of the NSA (Native Sparse Attention) kernel☆135Jun 24, 2025Updated last year
- ☆54Oct 22, 2026Updated 2 weeks ago
- Writing a CUDA software ray tracing renderer with Analysis-Driven Optimization from scratch: a python-importable, distributed parallel re…☆39Apr 12, 2026Updated 6 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- NCCL communication API layer, and transport layer created from first principles.☆16Aug 20, 2025Updated last year
- Database write ahead log in Rust.☆21Mar 15, 2025Updated last year
- Code repository for the SOSP'25 paper DCP: Addressing Input Dynamism In Long-Context Training via Dynamic Context Parallelism.☆23Nov 28, 2025Updated 11 months ago
- Process all your context faster with LLMs that can skim and selectively read what matters☆115Updated this week
- White furnace test implementation for GGX/Smith☆41Jan 14, 2018Updated 8 years ago
- Fast and memory-efficient exact attention☆22Sep 10, 2026Updated 2 months ago
- Reverse-engineered instruction set architecture database for NVIDIA SM120 (Blackwell) GPUs.☆29Updated this week
- ☆64Sep 27, 2026Updated last month
- Official FlashDecoder Github☆34Apr 4, 2026Updated 7 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Reference implementation and examples of the CuTe Layout representation and algebra.☆395Nov 3, 2026Updated last week
- 方剂聚类☆17Jul 18, 2018Updated 8 years ago
- Codes for GReTo accepted by ICLR2023☆12Mar 12, 2023Updated 3 years ago
- ☆12Sep 12, 2024Updated 2 years ago
- NVIDIA cuTile learn☆168Dec 9, 2025Updated 11 months ago
- ☆97Feb 5, 2026Updated 9 months ago
- An open, visual atlas of looped transformers, recurrent computation, adaptive depth, and latent reasoning.☆39Oct 28, 2026Updated 2 weeks ago
- Caffe implementation of DOOBNet https://arxiv.org/abs/1806.03772☆31Jan 6, 2021Updated 5 years ago
- An eBPF security research harness and telemetry dashboard built with C, libbpf-rs, and Ratatui to empirically measure kernel verifier bou…☆17Sep 18, 2026Updated last month
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- This is a mod management tool for Oblivion Remastered. I try to add features as modders develop them and have the goal of having this be…☆11May 30, 2025Updated last year
- ☆12May 29, 2022Updated 4 years ago
- PipeRAG: Fast Retrieval-Augmented Generation via Algorithm-System Co-design (KDD 2025)☆32Jun 14, 2024Updated 2 years ago
- ☆11Nov 6, 2022Updated 4 years ago
- A rust based risc-v operating system!☆12Feb 12, 2026Updated 8 months ago
- ☆68Feb 24, 2026Updated 8 months ago
- A high-performance pipeline-parallel runtime for large-scale MoE serving of agentic workloads. Also, a concise inference engine for curri…☆16Oct 12, 2026Updated 3 weeks ago
Are these results useful?