Distillation pipeline from pretrained Transformers to customized FLA models
☆13Aug 4, 2025Updated last year
Alternatives and similar repositories for distillation-fla
Users that are interested in distillation-fla are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- VibeRL is a Reinforcement Learning framework built essentially through vibe coding with Kimi K2.☆18Updated this week
- ☆38Dec 31, 2025Updated 9 months ago
- Efficient and unified implementations for TopK-based sparse attention☆41Jul 10, 2026Updated 3 months ago
- Triton implement of bi-directional (non-causal) linear attention☆83Aug 10, 2026Updated 2 months ago
- Comparative study and experimentation on standard vs mHC vs attention residual (full and block)☆13Mar 17, 2026Updated 7 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Claude Code agent skills for writing optimized Triton GPU kernels☆15Mar 6, 2026Updated 7 months ago
- ☆72Jul 8, 2025Updated last year
- Flash-Linear-Attention models beyond language☆21Aug 28, 2025Updated last year
- Mamba SSM architecture for packed data☆10Jul 1, 2024Updated 2 years ago
- Official repository Flash Local Linear Attention☆40May 28, 2026Updated 4 months ago
- Triton kernels and PyTorch ops for Block Attention Residuals (AttnRes)☆90May 29, 2026Updated 4 months ago
- The PIZZA dataset continues the exploration of task-oriented parsing by introducing a new dataset for parsing pizza and drink orders, who…☆20Dec 7, 2022Updated 3 years ago
- Official repository for "SSA: Sparse Sparse Attention by Aligning Full and Sparse Attention Outputs in Feature Space"☆32May 7, 2026Updated 5 months ago
- A Structured Span Selector (NAACL 2022). A structured span selector with a WCFG for span selection tasks (coreference resolution, semanti…☆21Jul 11, 2022Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- This repositories contains the reference implementation for the Sparse Delta Memory paper.More precisely, it contains the model definitio…☆41Jul 9, 2026Updated 3 months ago
- SuperTrack reimplementation in PyTorch and MuJoCo, with reproducible training and humanoid control experiments☆14Mar 9, 2026Updated 7 months ago
- Open-source toolkit for training, Priming, and serving next generation Hybrid architectures☆92Oct 2, 2026Updated 3 weeks ago
- Open-source codebase for PaMoRL, from "Parallelizing Model-based Reinforcement Learning Over the Sequence Length" at NeurIPS 2024.☆14Dec 17, 2024Updated last year
- The Newton-Muon optimizer☆35Jun 5, 2026Updated 4 months ago
- Agnost GitOps Helm charts☆13Dec 9, 2025Updated 10 months ago
- An efficient implementation of the NSA (Native Sparse Attention) kernel☆135Jun 24, 2025Updated last year
- ☆23Nov 6, 2025Updated 11 months ago
- Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)☆25Jun 6, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Implementation of Fast Weight Attention☆35Sep 17, 2026Updated last month
- Minimal PyTorch implementation of TP, SP, FSDP and sharded-EMA☆32Nov 27, 2025Updated 10 months ago
- ☆37Mar 7, 2025Updated last year
- WMarkGPT: Watermarked Image Understanding via Multimodal Large Language Models☆11Sep 18, 2025Updated last year
- ☆20Dec 24, 2024Updated last year
- [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models☆244Oct 14, 2025Updated last year
- ☆21Jun 27, 2024Updated 2 years ago
- Xmixers: A collection of SOTA efficient token/channel mixers☆29Sep 4, 2025Updated last year
- DeltaProduct is a new linear recurrent neural network architecture that uses products of generalized Householder matrices as state-transi…☆18Oct 13, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Pretraining Recurrent Networks without Recurrence☆76Jun 7, 2026Updated 4 months ago
- bootstrap my zsh shell☆16Mar 28, 2026Updated 6 months ago
- Random stuff related to CS224N that I'm making public. Not the main repository.☆27Dec 22, 2018Updated 7 years ago
- High-performance GPU kernels for LLM inference in OpenAI Triton. Fused RMSNorm, SwiGLU, INT8 GEMM with benchmarks and roofline analysis.☆44Jul 22, 2026Updated 3 months ago
- Tries to UI development. Clone of https://www.perplexity.ai/☆11Sep 30, 2023Updated 3 years ago
- ☆20Mar 6, 2026Updated 7 months ago
- Flash Attention in 300-500 lines of CUDA/C++☆39Aug 22, 2025Updated last year