Alternatives and similar repositories for DPO:

Users that are interested in DPO are comparing it to the libraries listed below

• jiahe7ay / infini-mini-transformer
  This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…
  ☆56Updated 10 months ago
• ZhuiyiTechnology / GAU-alpha
  基于Gated Attention Unit的Transformer模型（尝鲜版）
  ☆97Updated 2 years ago
• sugarandgugu / Simple-Trl-Training
  基于DPO算法微调语言大模型，简单好上手。
  ☆31Updated 8 months ago
• hengjiUSTC / learn-llm
  ☆104Updated 4 months ago
• seanzhang-zhichen / baichuan-Dynamic-NTK-ALiBi
  百川Dynamic NTK-ALiBi的代码实现：无需微调即可推理更长文本
  ☆47Updated last year
• akaihaoshuai / baby-llama2-chinese_cybertron
  使用单个24G显卡，从0开始训练LLM
  ☆50Updated 4 months ago
• keezen / ntk_alibi
  NTK scaled version of ALiBi position encoding in Transformer.
  ☆66Updated last year
• zhoucz97 / awesome-ChatGPT
  ChatGPT相关资源汇总
  ☆55Updated last year
• CLUEbenchmark / SuperCLUE-Math6
  SuperCLUE-Math6：新一代中文原生多轮多步数学推理数据集的探索之旅
  ☆53Updated last year
• DRSY / EMO
  [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)
  ☆119Updated last year
• suu990901 / LLaMA-MiLe-Loss
  Code for a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models
  ☆59Updated 3 weeks ago
• yegcjs / mixinglaws
  ☆96Updated 5 months ago
• LydiaXiaohongLi / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆19Updated last year
• bojone / analytical-classification
  逻辑回归和单层softmax的解析解
  ☆12Updated 3 years ago
• Outsider565 / LoRA-GA
  ☆180Updated 4 months ago
• xsysigma / TencentLLMEval
  TencentLLMEval is a comprehensive and extensive benchmark for artificial evaluation of large models that includes task trees, standards, …
  ☆38Updated 6 months ago
• CSHaitao / ChatGLM_mutli_gpu_tuning
  deepspeed+trainer简单高效实现多卡微调大模型
  ☆123Updated last year
• JunnYu / FLASHQuad_pytorch
  FLASHQuad_pytorch
  ☆67Updated 2 years ago
• firechecking / CleanTransformer
  an implementation of transformer, bert, gpt, and diffusion models for learning purposes
  ☆150Updated 4 months ago
• jiangxinyang227 / LLM-tuning
  llama，chatglm 等模型的微调
  ☆86Updated 7 months ago
• zms1999 / SmartMoE
  A MoE impl for PyTorch, [ATC'23] SmartMoE
  ☆61Updated last year
• l294265421 / alpaca-rlhf
  Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat
  ☆113Updated last year
• lc222 / BELLE-LORA
  LORA微调BLOOMZ，参考BELLE
  ☆25Updated last year
• cofe-ai / Mu-scaling
  Research without Re-search: Maximal Update Parametrization Yields Accurate Loss Prediction across Scales
  ☆31Updated last year
• IronBeliever / CaR
  Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation
  ☆75Updated 3 months ago
• princeton-nlp / CEPE
  [ACL 2024] Long-Context Language Modeling with Parallel Encodings
  ☆153Updated 8 months ago
• YJiangcm / FollowBench
  [ACL 2024] FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models
  ☆97Updated 3 months ago
• Longyichen / Alpaca-family-library
  Summarize all open source Large Languages Models and low-cost replication methods for Chatgpt.
  ☆135Updated last year
• infly-ai / INF-LLM
  The official repo of INF-34B models trained by INF Technology.
  ☆34Updated 7 months ago