research impl of Native Sparse Attention (2502.11089)
☆63Feb 19, 2025Updated last year
Alternatives and similar repositories for NativeSparseAttention
Users that are interested in NativeSparseAttention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆13Nov 14, 2024Updated last year
- Focused on fast experimentation and simplicity☆77Dec 24, 2024Updated last year
- ☆33Sep 10, 2024Updated 2 years ago
- Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paper☆817Aug 15, 2025Updated last year
- ☆27Jan 22, 2026Updated 9 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- PolarGrad: A Class of Matrix-Gradient Optimizers from a Unifying Preconditioning Perspective☆18Aug 10, 2026Updated 2 months ago
- JAX Implementations of Descript Audio Codec and EnCodec☆38Aug 23, 2026Updated 2 months ago
- fuchsia: minimal libaray for RL on LLMs☆10Mar 8, 2026Updated 7 months ago
- ☆30Dec 2, 2024Updated last year
- ☆33Jan 6, 2025Updated last year
- An experiment to see if chatgpt can improve the output of the stanford alpaca dataset☆12Mar 29, 2023Updated 3 years ago
- supporting pytorch FSDP for optimizers☆85Dec 8, 2024Updated last year
- Handles everything related to working with instruction datasets☆11Dec 19, 2023Updated 2 years ago
- Unofficial Tensorflow 2 implementation of SINet: Extreme Lightweight Portrait Segmentation Networks with Spatial Squeeze Modules and Info…☆15Jul 20, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- An efficient implementation of the NSA (Native Sparse Attention) kernel☆135Jun 24, 2025Updated last year
- singing voice conversion based on glow-tts☆12Aug 20, 2023Updated 3 years ago
- Repository with which to explore k-diffusion and diffusers, and within which changes to said packages may be tested.☆54Jan 28, 2024Updated 2 years ago
- T5 model optimized with FlexAttention☆14Sep 30, 2024Updated 2 years ago
- ☆32Aug 18, 2026Updated 2 months ago
- The source code for the paper CrossSinger (asru2023)☆18Oct 12, 2023Updated 3 years ago
- ☆20Aug 12, 2025Updated last year
- ☆54May 19, 2025Updated last year
- Fully customizable Classifer Free Guidance for ComfyUI☆15Jul 14, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆24Jun 18, 2024Updated 2 years ago
- A way of doing first-principles off-policy RL by treating Q-values as probability distrubuitions☆12Oct 30, 2025Updated 11 months ago
- Train VAE like a boss☆313Oct 21, 2024Updated 2 years ago
- CIFAR-10 speedrun: Trains to 94% accuracy in 1.98 seconds on a single NVIDIA A100 GPU.☆86Jul 30, 2026Updated 2 months ago
- Efficient optimizers☆340Sep 9, 2026Updated last month
- ☆12Sep 22, 2025Updated last year
- Reclaim disk space from build artifacts. Rust TUI for cleaning target/, node_modules/, bin/, and obj/ across your workspace.☆16Aug 2, 2026Updated 2 months ago
- Writing FLUX in Triton☆42Sep 22, 2024Updated 2 years ago
- Code for "What really matters in matrix-whitening optimizers?"☆25Oct 31, 2025Updated 11 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- DeMo: Decoupled Momentum Optimization☆202Dec 2, 2024Updated last year
- This is our Final Year Project titled " Implementation of seam carving for image retargeting using CUDA enabled GPU"☆11Nov 16, 2024Updated last year
- Experiment of using Tangent to autodiff triton☆81Jan 22, 2024Updated 2 years ago
- PyTorch interface for TrueGrad Optimizers☆43Aug 8, 2023Updated 3 years ago
- LM/VLM implementations☆12Oct 13, 2026Updated 2 weeks ago
- Testing various improvements to Ranger21 for 2022☆19Nov 6, 2024Updated last year
- An optimized FastAPI server for OpenAI's Whisper whisper-large-v3-turbo model using MLX optimization☆14Jun 5, 2025Updated last year