deepreinforce-ai / CUDA-L1Links
CUDA-L1: Improving CUDA Optimization via Contrastive Reinforcement Learning
☆195Updated this week
Alternatives and similar repositories for CUDA-L1
Users that are interested in CUDA-L1 are comparing it to the libraries listed below
Sorting:
- Load compute kernels from the Hub☆308Updated this week
- Simple & Scalable Pretraining for Neural Architecture Research☆297Updated 2 months ago
- A collection of tricks and tools to speed up transformer models☆182Updated this week
- 👷 Build compute kernels☆163Updated this week
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆103Updated 2 weeks ago
- ☆102Updated last week
- QeRL enables RL for 32B LLMs on a single H100 GPU.☆361Updated last week
- ☆251Updated 4 months ago
- Work in progress.☆74Updated 4 months ago
- PyTorch implementation of models from the Zamba2 series.☆185Updated 9 months ago
- Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.☆147Updated 2 weeks ago
- Efficient LLM Inference over Long Sequences☆390Updated 4 months ago
- open source alpha evolve☆66Updated 5 months ago
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆300Updated 2 months ago
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆130Updated 10 months ago
- ☆152Updated 4 months ago
- Official repository for the paper "NeuZip: Memory-Efficient Training and Inference with Dynamic Compression of Neural Networks". This rep…☆59Updated 11 months ago
- dInfer: An Efficient Inference Framework for Diffusion Language Models☆244Updated last week
- GRadient-INformed MoE☆264Updated last year
- A safetensors extension to efficiently store sparse quantized tensors on disk☆180Updated last week
- Official implementation of the paper: "ZClip: Adaptive Spike Mitigation for LLM Pre-Training".☆136Updated 2 weeks ago
- Samples of good AI generated CUDA kernels☆91Updated 4 months ago
- DeMo: Decoupled Momentum Optimization☆194Updated 10 months ago
- ☆163Updated 3 months ago
- ☆65Updated 7 months ago
- Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"☆248Updated 8 months ago
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆197Updated 4 months ago
- RLP: Reinforcement as a Pretraining Objective☆192Updated 3 weeks ago
- This repo contains the source code for the paper "Evolution Strategies at Scale: LLM Fine-Tuning Beyond Reinforcement Learning"☆229Updated this week
- The evaluation framework for training-free sparse attention in LLMs☆102Updated 2 weeks ago