Alternatives and similar repositories for Ray_Tutorial

Users that are interested in Ray_Tutorial are comparing it to the libraries listed below

• rlite-project / RLite
  A lightweight reinforcement learning framework that integrates seamlessly into your codebase, empowering developers to focus on algorithm…
  ☆95Updated 4 months ago
• qingkelab / qingketalk
  青稞Talk
  ☆180Updated 3 weeks ago
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆138Updated last year
• jiahe7ay / infini-mini-transformer
  This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…
  ☆58Updated last year
• zms1999 / SmartMoE
  A MoE impl for PyTorch, [ATC'23] SmartMoE
  ☆71Updated 2 years ago
• Ascend / AscendSpeed
  ☆79Updated 2 years ago
• dhcode-cpp / NSA-pytorch
  DeepSeek Native Sparse Attention pytorch implementation
  ☆110Updated 2 weeks ago
• liangyuwang / Tiny-FSDP
  Tiny-FSDP, a minimalistic re-implementation of the PyTorch FSDP
  ☆93Updated 4 months ago
• ironartisan / awesome-compression1
  模型压缩的小白入门教程
  ☆22Updated last year
• zhaochenyang20 / ModelServer
  Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang
  ☆61Updated last year
• yyht / openrlhf_async_pipline
  ☆87Updated 4 months ago
• step-law / steplaw
  ☆208Updated 2 months ago
• dhcode-cpp / grpo-loss
  ☆39Updated 9 months ago
• microsoft / nanovppo
  Nano repo for RL training of LLMs
  ☆70Updated 2 months ago
• HarderThenHarder / RLLoggingBoard
  A visuailzation tool to make deep understaning and easier debugging for RLHF training.
  ☆275Updated 10 months ago
• OpenNLPLab / lightning-attention
  Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models
  ☆338Updated 10 months ago
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆41Updated last year
• sgl-project / sgl-cookbook
  Cookbook of SGLang - Recipe
  ☆45Updated this week
• shreyansh26 / FlashAttention-PyTorch
  Implementation of FlashAttention in PyTorch
  ☆178Updated 11 months ago
• jackfsuia / nanoRLHF
  RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.
  ☆76Updated 10 months ago
• mdy666 / Qwen-Native-Sparse-Attention
  qwen-nsa
  ☆86Updated 2 months ago
• intelligent-machine-learning / atorch
  An industrial extension library of pytorch to accelerate large scale model training
  ☆56Updated 4 months ago
• mdy666 / Scalable-Flash-Native-Sparse-Attention
  ☆47Updated 2 weeks ago
• JT-Ushio / MHA2MLA
  Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
  ☆198Updated 3 weeks ago
• HFAiLab / hfai-models
  HFAI deep learning models
  ☆156Updated 2 years ago
• BBuf / flash-rwkv
  ☆32Updated last year
• pprp / Awesome-Efficient-MoE
  Efficient Mixture of Experts for LLM Paper List
  ☆153Updated 3 months ago
• GAIR-NLP / MAYE
  Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme
  ☆146Updated 8 months ago
• Wangmerlyn / MCTS-GSM8k-Demo
  This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems
  ☆94Updated last month
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆78Updated last year