mindspore-lab / mindrlhf

Related projects ⓘ

Alternatives and complementary repositories for mindrlhf

• yanqiangmiffy / how-to-train-tokenizer
  怎么训练一个LLM分词器
  ☆129Updated last year
• genggui001 / Megatron-DeepSpeed-Llama
  ☆82Updated last year
• l294265421 / alpaca-rlhf
  Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat
  ☆106Updated last year
• akaihaoshuai / baby-llama2-chinese_cybertron
  使用单个24G显卡，从0开始训练LLM
  ☆49Updated 2 weeks ago
• hengjiUSTC / learn-llm
  ☆81Updated this week
• CoinCheung / gdGPT
  Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
  ☆90Updated 9 months ago
• zhanshijinwat / Steel-LLM
  Train a Chinese LLM From 0 by Personal
  ☆201Updated last week
• alibaba / ChatLearn
  ☆199Updated this week
• sufengniu / RefGPT
  ☆157Updated last year
• mindspore-lab / mindformers
  ☆143Updated this week
• THUDM / AlignBench
  大模型多维度中文对齐评测基准 (ACL 2024)
  ☆331Updated 2 months ago
• keezen / ntk_alibi
  NTK scaled version of ALiBi position encoding in Transformer.
  ☆66Updated last year
• stanleylsx / llms_tool
  一个基于HuggingFace开发的大语言模型训练、测试工具。支持各模型的webui、终端预测，低参数量及全参数模型训练(预训练、SFT、RM、PPO、DPO)和融合、量化。
  ☆202Updated 11 months ago
• Glanvery / LLM-Travel
  欢迎来到 "LLM-travel" 仓库！探索大语言模型（LLM）的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。
  ☆266Updated 3 months ago
• aplmikex / deduplication_mnbvc
  文本去重
  ☆67Updated 5 months ago
• Miraclemarvel55 / ChatGLM-RLHF
  对ChatGLM直接使用RLHF提升或降低目标输出概率|Modify ChatGLM output with only RLHF
  ☆189Updated last year
• CASIA-LM / ChineseWebText
  ☆158Updated last year
• CASIA-LM / MoDS
  ☆118Updated 6 months ago
• OpenLMLab / scaling-rope
  code for Scaling Laws of RoPE-based Extrapolation
  ☆70Updated last year
• cauyxy / bilivideos
  ☆51Updated last year
• Pillars-Creation / ChatGLM-RLHF-LoRA-RM-PPO
  ChatGLM-6B添加了RLHF的实现，以及部分核心代码的逐行讲解 ,实例部分是做了个新闻短标题的生成，以及指定context推荐的RLHF的实现
  ☆78Updated last year
• bojone / NBCE
  Naive Bayes-based Context Extension
  ☆313Updated last year
• zms1999 / SmartMoE
  A MoE impl for PyTorch, [ATC'23] SmartMoE
  ☆57Updated last year
• OFA-Sys / InsTag
  InsTag: A Tool for Data Analysis in LLM Supervised Fine-tuning
  ☆214Updated last year
• OpenBMB / ModelCenter
  Efficient, Low-Resource, Distributed transformer implementation based on BMTrain
  ☆241Updated 11 months ago
• zexuanqiu / CLongEval
  CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models
  ☆38Updated 8 months ago
• volcengine / verl
  veRL: Volcano Engine Reinforcement Learning for LLM
  ☆297Updated this week
• CLUEbenchmark / SuperCLUE-Math6
  SuperCLUE-Math6：新一代中文原生多轮多步数学推理数据集的探索之旅
  ☆44Updated 9 months ago
• tianyi-lab / Cherry_LLM
  [NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other mo…
  ☆305Updated 2 months ago
• ProjectD-AI / LLaMA-Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆69Updated last year