mit-han-lab / fastrlLinks
Efficient Reinforcement Learning for Language Models
☆43Updated this week
Alternatives and similar repositories for fastrl
Users that are interested in fastrl are comparing it to the libraries listed below
Sorting:
- ☆39Updated 3 months ago
- ☆143Updated this week
- ☆50Updated 6 months ago
- Accelerate LLM preference tuning via prefix sharing with a single line of code☆51Updated 4 months ago
- An auxiliary project analysis of the characteristics of KV in DiT Attention.☆32Updated 11 months ago
- Quantized Attention on GPU☆44Updated last year
- Debug print operator for cudagraph debugging☆14Updated last year
- A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters☆52Updated last year
- An experimental communicating attention kernel based on DeepEP.☆34Updated 3 months ago
- [NeurIPS'25 Spotlight] Adaptive Attention Sparsity with Hierarchical Top-p Pruning☆67Updated last week
- ☆19Updated 10 months ago
- Transformers components but in Triton☆34Updated 6 months ago
- ☆22Updated 8 months ago
- Nex Venus Communication Library☆50Updated this week
- Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference☆154Updated last month
- DeeperGEMM: crazy optimized version☆73Updated 6 months ago
- An efficient implementation of the NSA (Native Sparse Attention) kernel☆124Updated 4 months ago
- APRIL: Active Partial Rollouts in Reinforcement Learning to Tame Long-tail Generation. A system-level optimization for scalable LLM tra…☆43Updated last month
- [ICML 2025] XAttention: Block Sparse Attention with Antidiagonal Scoring☆254Updated 4 months ago
- Fast and memory-efficient exact attention☆14Updated this week
- ☆65Updated 6 months ago
- 🔥 LLM-powered GPU kernel synthesis: Train models to convert PyTorch ops into optimized Triton kernels via SFT+RL. Multi-turn compilation…☆99Updated last week
- 16-fold memory access reduction with nearly no loss☆107Updated 7 months ago
- [ACL 2025] Squeezed Attention: Accelerating Long Prompt LLM Inference☆54Updated last year
- Estimate MFU for DeepSeekV3☆26Updated 10 months ago
- ☆57Updated last week
- [ICML 2025] SparseLoRA: Accelerating LLM Fine-Tuning with Contextual Sparsity☆60Updated 4 months ago
- ☆121Updated 3 months ago
- ☆20Updated 8 months ago
- Fast and memory-efficient exact kmeans☆122Updated last week