research impl of Native Sparse Attention (2502.11089)
☆63Feb 19, 2025Updated last year
Alternatives and similar repositories for NativeSparseAttention
Users that are interested in NativeSparseAttention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆13Nov 14, 2024Updated 2 years ago
- Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paper☆817Aug 15, 2025Updated last year
- Fast, Numerically Stable, and Auto-Differentiable Spectral Clipping via Newton-Schulz Iteration☆12Jun 21, 2025Updated last year
- Focused on fast experimentation and simplicity☆77Dec 24, 2024Updated last year
- ☆33Sep 10, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- An efficient implementation of the NSA (Native Sparse Attention) kernel☆135Jun 24, 2025Updated last year
- ☆14Oct 3, 2024Updated 2 years ago
- JAX Implementations of Descript Audio Codec and EnCodec☆38Aug 23, 2026Updated 2 months ago
- fuchsia: minimal libaray for RL on LLMs☆10Mar 8, 2026Updated 8 months ago
- ☆33Jan 6, 2025Updated last year
- Lightweight package that tracks and summarizes code changes using LLMs (Large Language Models)☆32Feb 27, 2025Updated last year
- 🐳 Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"☆1,029Feb 5, 2026Updated 9 months ago
- An experiment to see if chatgpt can improve the output of the stanford alpaca dataset☆12Mar 29, 2023Updated 3 years ago
- supporting pytorch FSDP for optimizers☆85Dec 8, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆67Mar 4, 2024Updated 2 years ago
- Handles everything related to working with instruction datasets☆11Dec 19, 2023Updated 2 years ago
- Efficient triton implementation of Native Sparse Attention.☆286May 23, 2025Updated last year
- singing voice conversion based on glow-tts☆12Aug 20, 2023Updated 3 years ago
- ☆14May 4, 2026Updated 6 months ago
- Repository with which to explore k-diffusion and diffusers, and within which changes to said packages may be tested.☆54Jan 28, 2024Updated 2 years ago
- rl from zero pretrain, can it be done? yes.☆297Sep 28, 2025Updated last year
- WIP☆97Aug 13, 2024Updated 2 years ago
- A way of doing first-principles off-policy RL by treating Q-values as probability distrubuitions☆12Oct 30, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- A tool for assignment to a slice in TensorFlow☆20Jul 23, 2021Updated 5 years ago
- ☆54May 19, 2025Updated last year
- Efficient optimizers☆340Sep 9, 2026Updated 2 months ago
- Fully customizable Classifer Free Guidance for ComfyUI☆15Jul 14, 2024Updated 2 years ago
- Code for "What really matters in matrix-whitening optimizers?"☆25Oct 31, 2025Updated last year
- Train VAE like a boss☆313Oct 21, 2024Updated 2 years ago
- Official repo for DisCoder: High-Fidelity Music Vocoder using Neural Audio Codecs presented at ICASSP 2025☆49Feb 24, 2025Updated last year
- Scaled Uniform Noise for Ancestral & Stochastic samplers and Noisy latent image☆18Mar 30, 2025Updated last year
- Experiment of using Tangent to autodiff triton☆81Jan 22, 2024Updated 2 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- This is our Final Year Project titled " Implementation of seam carving for image retargeting using CUDA enabled GPU"☆11Nov 16, 2024Updated 2 years ago
- DeMo: Decoupled Momentum Optimization☆202Dec 2, 2024Updated last year
- LM/VLM implementations☆12Oct 13, 2026Updated last month
- A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.☆34May 29, 2023Updated 3 years ago
- ☆20Oct 11, 2023Updated 3 years ago
- An optimized FastAPI server for OpenAI's Whisper whisper-large-v3-turbo model using MLX optimization☆14Jun 5, 2025Updated last year
- Official Implementation of the paper: A Complete Recipe for Diffusion Generative Models☆31Nov 1, 2024Updated 2 years ago
Are these results useful?