Alternatives and similar repositories for ChatLearn

Users that are interested in ChatLearn are comparing it to the libraries listed below

• alibaba / Megatron-LLaMA
  Best practice for training LLaMA models in Megatron-LM
  ☆664Updated last year
• openpsi-project / ReaLHF
  Super-Efficient RLHF Training of LLMs with Parameter Reallocation
  ☆330Updated 8 months ago
• LLaMafia / llamafia.github
  ☆320Updated last year
• OpenBMB / InfiniteBench
  Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718
  ☆367Updated last year
• flagos-ai / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆430Updated last week
• modelscope / Trinity-RFT
  Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (…
  ☆458Updated this week
• InternLM / InternEvo
  InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencie…
  ☆416Updated 4 months ago
• Strivin0311 / long-llms-learning
  A repository sharing the literatures about long-context large language models, including the methodologies and the evaluation benchmarks
  ☆270Updated last year
• a-m-team / a-m-models
  a-m-team's exploration in large language modeling
  ☆195Updated 7 months ago
• OpenBMB / UltraEval
  [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.
  ☆253Updated last year
• HarderThenHarder / RLLoggingBoard
  A visuailzation tool to make deep understaning and easier debugging for RLHF training.
  ☆275Updated 10 months ago
• infinigence / LVEval
  Repository of LV-Eval Benchmark
  ☆73Updated last year
• OpenBMB / BMTrain
  Efficient Training (including pre-training and fine-tuning) for Big Models
  ☆614Updated 2 months ago
• THUDM / LongBench
  LongBench v2 and LongBench (ACL 25'&24')
  ☆1,050Updated 11 months ago
• HuangLK / transpeeder
  train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism
  ☆225Updated 2 years ago
• THUDM / LongAlign
  [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs
  ☆257Updated last year
• alipay / PainlessInferenceAcceleration
  Accelerate inference without tears
  ☆370Updated last month
• OpenMOSS / CoLLiE
  Collaborative Training of Large Language Models in an Efficient Way
  ☆417Updated last year
• ISEEKYAN / mbridge
  Bridge Megatron-Core to Hugging Face/Reinforcement Learning
  ☆174Updated last week
• CoinCheung / gdGPT
  Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
  ☆98Updated last year
• CASIA-LM / ChineseWebText
  ☆182Updated 2 years ago
• mindspore-lab / mindrlhf
  ☆36Updated last year
• SkyworkAI / skywork-o1-prm-inference
  ☆65Updated last year
• genggui001 / Megatron-DeepSpeed-Llama
  ☆84Updated 2 years ago
• HKUNLP / ChunkLlama
  [ICML'24] Data and code for our paper "Training-Free Long-Context Scaling of Large Language Models"
  ☆447Updated last year
• MoFHeka / LLaMA-Megatron
  A LLaMA1/LLaMA12 Megatron implement.
  ☆28Updated 2 years ago
• wjn1996 / Awesome-LLM-Reasoning-Openai-o1-Survey
  The related works and background techniques about Openai o1
  ☆221Updated 11 months ago
• step-law / steplaw
  ☆208Updated 2 months ago
• FlagAI-Open / OpenSeek
  OpenSeek aims to unite the global open source community to drive collaborative innovation in algorithms, data and systems to develop next…
  ☆240Updated this week
• feifeibear / long-context-attention
  USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
  ☆618Updated last week