Alternatives and similar repositories for Ray_Tutorial:

Users that are interested in Ray_Tutorial are comparing it to the libraries listed below

• Wangmerlyn / MCTS-GSM8k-Demo
  This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems
  ☆49Updated last month
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆128Updated 8 months ago
• zms1999 / SmartMoE
  A MoE impl for PyTorch, [ATC'23] SmartMoE
  ☆61Updated last year
• HarderThenHarder / RLLoggingBoard
  A visuailzation tool to make deep understaning and easier debugging for RLHF training.
  ☆148Updated this week
• SkyworkAI / skywork-o1-prm-inference
  ☆57Updated 2 months ago
• ttumiel / minRLHF
  Minimal RLHF implementation built on top of minGPT.
  ☆29Updated 7 months ago
• openpsi-project / srl
  A Really Scalable RL Framework to 10k+ CPUs
  ☆25Updated 11 months ago
• swtheing / PF-PPO-RLHF
  ☆30Updated 5 months ago
• bytarnish / AGILE
  ☆88Updated last month
• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆39Updated 3 months ago
• sail-sg / VocabularyParallelism
  Vocabulary Parallelism
  ☆17Updated 3 months ago
• pprp / Awesome-Efficient-MoE
  Efficient Mixture of Experts for LLM Paper List
  ☆36Updated 2 months ago
• APEXLAB / CodeApex
  ☆48Updated last year
• waterhorse1 / Natural-language-RL
  Natural Language Reinforcement Learning
  ☆72Updated 2 months ago
• feifeibear / DPSKV3MFU
  Estimate MFU for DeepSeekV3
  ☆16Updated last month
• OpenNLPLab / LASP
  Linear Attention Sequence Parallelism (LASP)
  ☆77Updated 8 months ago
• SqueezeAILab / SqueezedAttention
  SQUEEZED ATTENTION: Accelerating Long Prompt LLM Inference
  ☆40Updated 3 months ago
• TemporaryLoRA / Temp-LoRA
  ☆96Updated 10 months ago
• Gaffey / ExCP
  Official implementation of ICML 2024 paper "ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinking".
  ☆46Updated 7 months ago
• BBuf / flash-rwkv
  ☆30Updated 8 months ago
• amazon-science / piperag
  PipeRAG: Fast Retrieval-Augmented Generation via Algorithm-System Co-design (KDD 2025)
  ☆17Updated 8 months ago
• thunlp / Ouroboros
  Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)
  ☆84Updated 4 months ago
• Open-Source-O1 / o1_Reasoning_Patterns_Study
  ☆98Updated 2 months ago
• mdy666 / mdy_triton
  ☆62Updated last week
• sail-sg / SimLayerKV
  The official implementation of paper: SimLayerKV: A Simple Framework for Layer-Level KV Cache Reduction.
  ☆42Updated 4 months ago
• BBuf / megatron-lm-parallel-group-playground
  ☆14Updated 10 months ago