research impl of Native Sparse Attention (2502.11089)
☆63Feb 19, 2025Updated last year
Alternatives and similar repositories for NativeSparseAttention
Users that are interested in NativeSparseAttention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Focused on fast experimentation and simplicity☆80Dec 24, 2024Updated last year
- ☆23Jun 18, 2024Updated last year
- Official repo for DisCoder: High-Fidelity Music Vocoder using Neural Audio Codecs presented at ICASSP 2025☆39Feb 24, 2025Updated last year
- ☆14Oct 3, 2024Updated last year
- Maximal Update Parametrization (μP) with Flax & Optax.☆16Dec 27, 2023Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆67Mar 4, 2024Updated 2 years ago
- Repository with which to explore k-diffusion and diffusers, and within which changes to said packages may be tested.☆55Jan 28, 2024Updated 2 years ago
- ☆28Oct 7, 2025Updated 5 months ago
- rl from zero pretrain, can it be done? yes.☆290Sep 28, 2025Updated 5 months ago
- PyTorch interface for TrueGrad Optimizers☆43Aug 8, 2023Updated 2 years ago
- supporting pytorch FSDP for optimizers☆84Dec 8, 2024Updated last year
- Experiment of using Tangent to autodiff triton☆82Jan 22, 2024Updated 2 years ago
- Efficient triton implementation of Native Sparse Attention.☆270May 23, 2025Updated 10 months ago
- Unofficial Tensorflow 2 implementation of SINet: Extreme Lightweight Portrait Segmentation Networks with Spatial Squeeze Modules and Info…☆15Jul 20, 2022Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- An efficient implementation of the NSA (Native Sparse Attention) kernel☆132Jun 24, 2025Updated 9 months ago
- ☆30Dec 2, 2024Updated last year
- VI-SVC model is just VITS without MAS and DurationPredictor.☆10Nov 9, 2023Updated 2 years ago
- A tool for assignment to a slice in TensorFlow☆20Jul 23, 2021Updated 4 years ago
- ☆13Jan 15, 2025Updated last year
- WIP☆95Aug 13, 2024Updated last year
- singing voice conversion based on glow-tts☆12Aug 20, 2023Updated 2 years ago
- DeMo: Decoupled Momentum Optimization☆198Dec 2, 2024Updated last year
- JAX Implementations of Descript Audio Codec and EnCodec☆34Mar 30, 2025Updated 11 months ago
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- ☆18Aug 24, 2024Updated last year
- 4G GPU & 10 Minutes for train☆12Aug 9, 2023Updated 2 years ago
- Ultra low overhead NVIDIA GPU telemetry plugin for telegraf with memory temperature readings.☆63Jul 8, 2024Updated last year
- Alpha-Zero Connect Four NN trained via self play☆26Mar 7, 2025Updated last year
- ☆22Nov 18, 2025Updated 4 months ago
- Load & manage evolving datasets efficiently☆23Aug 22, 2025Updated 7 months ago
- 🐳 Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"☆977Feb 5, 2026Updated last month
- The source code for the paper CrossSinger (asru2023)☆18Oct 12, 2023Updated 2 years ago
- Testing various improvements to Ranger21 for 2022☆19Nov 6, 2024Updated last year
- NordVPN Special Discount Offer • AdSave on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
- Official Implementation of the paper: A Complete Recipe for Diffusion Generative Models☆30Nov 1, 2024Updated last year
- Writing FLUX in Triton☆42Sep 22, 2024Updated last year
- Train VAE like a boss☆313Oct 21, 2024Updated last year
- Code for "What really matters in matrix-whitening optimizers?"☆23Oct 31, 2025Updated 4 months ago
- Efficient optimizers☆297Updated this week
- TOPLOC: is a novel method for verifiable inference that enables users to verify that LLM providers are using the correct model configurat…☆52Apr 14, 2025Updated 11 months ago
- ☆12Nov 7, 2024Updated last year