Alternatives and similar repositories for Ray_Tutorial

Users that are interested in Ray_Tutorial are comparing it to the libraries listed below

• rlite-project / RLite
  A lightweight reinforcement learning framework that integrates seamlessly into your codebase, empowering developers to focus on algorithm…
  ☆98Updated 4 months ago
• qingkelab / qingketalk
  青稞Talk
  ☆186Updated last week
• liangyuwang / Tiny-FSDP
  Tiny-FSDP, a minimalistic re-implementation of the PyTorch FSDP
  ☆93Updated 5 months ago
• zms1999 / SmartMoE
  A MoE impl for PyTorch, [ATC'23] SmartMoE
  ☆71Updated 2 years ago
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆138Updated last year
• Ascend / AscendSpeed
  ☆79Updated 2 years ago
• zhaochenyang20 / ModelServer
  Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang
  ☆61Updated last year
• jiahe7ay / infini-mini-transformer
  This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…
  ☆58Updated last year
• yyht / openrlhf_async_pipline
  ☆87Updated 5 months ago
• dhcode-cpp / grpo-loss
  ☆39Updated 10 months ago
• microsoft / nanovppo
  Nano repo for RL training of LLMs
  ☆70Updated 2 months ago
• HarderThenHarder / RLLoggingBoard
  A visuailzation tool to make deep understaning and easier debugging for RLHF training.
  ☆280Updated 11 months ago
• intelligent-machine-learning / atorch
  An industrial extension library of pytorch to accelerate large scale model training
  ☆58Updated 5 months ago
• ironartisan / awesome-compression1
  模型压缩的小白入门教程
  ☆22Updated last year
• dhcode-cpp / NSA-pytorch
  DeepSeek Native Sparse Attention pytorch implementation
  ☆111Updated last month
• liangyuwang / Tiny-DeepSpeed
  Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library
  ☆49Updated 5 months ago
• mdy666 / Scalable-Flash-Native-Sparse-Attention
  ☆47Updated last month
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆40Updated 2 years ago
• liangyuwang / zo2
  ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory [COLM2025]
  ☆198Updated 6 months ago
• GAIR-NLP / MAYE
  Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme
  ☆146Updated 9 months ago
• jackfsuia / nanoRLHF
  RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.
  ☆78Updated 11 months ago
• tiannuo-yang / SearchAgent-X
  A High-Efficiency System of Large Language Model Based Search Agents
  ☆74Updated 6 months ago
• OpenNLPLab / lightning-attention
  Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models
  ☆339Updated 10 months ago
• chenweiphd / DeepSeek-MoE-ResourceMap
  ☆135Updated 11 months ago
• shreyansh26 / FlashAttention-PyTorch
  Implementation of FlashAttention in PyTorch
  ☆180Updated last year
• SkyworkAI / Skywork-Reward-V2
  Scaling Preference Data Curation via Human-AI Synergy
  ☆135Updated 6 months ago
• step-law / steplaw
  ☆209Updated 2 months ago
• crazycth / WizardLearner
  Pretrain、decay、SFT a CodeLLM from scratch 🧙‍♂️
  ☆40Updated last year
• BBuf / flash-rwkv
  ☆32Updated last year
• JT-Ushio / MHA2MLA
  Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
  ☆200Updated last month