Alternatives and similar repositories for QeRL

Users that are interested in QeRL are comparing it to the libraries listed below

• deepreinforce-ai / CUDA-L1
  CUDA-L1: Improving CUDA Optimization via Contrastive Reinforcement Learning
  ☆243Updated 3 weeks ago
• thu-nics / MoA
  [CoLM'25] The official implementation of the paper <MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression>
  ☆150Updated 4 months ago
• tilde-research / nsa-impl
  An efficient implementation of the NSA (Native Sparse Attention) kernel
  ☆126Updated 5 months ago
• PiotrNawrot / sparse-frontier
  The evaluation framework for training-free sparse attention in LLMs
  ☆104Updated last month
• Dao-AILab / grouped-latent-attention
  ☆132Updated 6 months ago
• inclusionAI / dInfer
  dInfer: An Efficient Inference Framework for Diffusion Language Models
  ☆327Updated this week
• XunhaoLai / native-sparse-attention-triton
  Efficient triton implementation of Native Sparse Attention.
  ☆250Updated 6 months ago
• nil0x9 / flash-muon
  Flash-Muon: An Efficient Implementation of Muon Optimizer
  ☆206Updated 5 months ago
• hao-ai-lab / Awesome-Video-Attention
  A curated list of recent papers on efficient video attention for video diffusion models, including sparsification, quantization, and cach…
  ☆48Updated last month
• JT-Ushio / MHA2MLA
  Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
  ☆195Updated last month
• mit-han-lab / flash-moba
  ☆187Updated last week
• ByteDance-Seed / FlexPrefill
  Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference
  ☆155Updated last month
• Infini-AI-Lab / Multiverse
  ☆103Updated 2 months ago
• yaof20 / Flash-RL
  Implementation for FP8/INT8 Rollout for RL training without performence drop.
  ☆275Updated 3 weeks ago
• ZihanWang314 / CoE
  Chain of Experts (CoE) enables communication between experts within Mixture-of-Experts (MoE) models
  ☆224Updated 3 weeks ago
• IST-DASLab / Quartet
  ☆110Updated last week
• JinjieNi / MegaDLMs
  GPU-optimized framework for training diffusion language models at any scale. The backend of Quokka, Super Data Learners, and OpenMoE 2 tr…
  ☆283Updated 2 weeks ago
• NVIDIA / Star-Attention
  Efficient LLM Inference over Long Sequences
  ☆391Updated 5 months ago
• IsaacRe / vllm-kvcompress
  KV cache compression for high-throughput LLM inference
  ☆143Updated 9 months ago
• NVlabs / MaskLLM
  [NeurIPS 24 Spotlight] MaskLLM: Learnable Semi-structured Sparsity for Large Language Models
  ☆180Updated 10 months ago
• HanGuo97 / log-linear-attention
  ☆256Updated 5 months ago
• OpenBMB / infllmv2_cuda_impl
  ☆73Updated last month
• eqimp / hogwild_llm
  Official PyTorch implementation for Hogwild! Inference: Parallel LLM Generation with a Concurrent Attention Cache
  ☆133Updated 3 months ago
• radixark / miles
  ☆317Updated this week
• Multiverse4FM / Multiverse
  ☆84Updated 5 months ago
• NVIDIA-NeMo / Automodel
  Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support
  ☆187Updated this week
• inclusionAI / Ring-V2
  Ring-V2 is a reasoning MoE LLM provided and open-sourced by InclusionAI.
  ☆81Updated last month
• mit-han-lab / x-attention
  [ICML 2025] XAttention: Block Sparse Attention with Antidiagonal Scoring
  ☆255Updated 4 months ago
• IST-DASLab / QuEST
  Work in progress.
  ☆75Updated 5 months ago
• deepseek-ai / LPLB
  An early research stage MoE load balancer based on inear programming.
  ☆415Updated last week