Alternatives and similar repositories for 360-LLaMA-Factory:

Users that are interested in 360-LLaMA-Factory are comparing it to the libraries listed below

• tianyi-lab / Cherry_LLM
  [NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other mo…
  ☆333Updated 4 months ago
• alibaba / ChatLearn
  A flexible and efficient training framework for large-scale alignment tasks
  ☆281Updated this week
• CASIA-LM / MoDS
  ☆128Updated 9 months ago
• CASIA-LM / ChineseWebText
  ☆161Updated last year
• wjn1996 / Awesome-LLM-Reasoning-Openai-o1-Survey
  The related works and background techniques about Openai o1
  ☆195Updated 3 weeks ago
• LLaMafia / llamafia.github
  ☆317Updated 6 months ago
• Ablustrund / LoRAMoE
  LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment
  ☆273Updated 9 months ago
• OFA-Sys / InsTag
  InsTag: A Tool for Data Analysis in LLM Supervised Fine-tuning
  ☆237Updated last year
• princeton-nlp / CEPE
  [ACL 2024] Long-Context Language Modeling with Parallel Encodings
  ☆154Updated 7 months ago
• CoinCheung / gdGPT
  Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
  ☆92Updated 11 months ago
• l294265421 / alpaca-rlhf
  Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat
  ☆109Updated last year
• THUDM / LongAlign
  [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs
  ☆238Updated last month
• Strivin0311 / long-llms-learning
  A repository sharing the literatures about long-context large language models, including the methodologies and the evaluation benchmarks
  ☆256Updated 6 months ago
• openpsi-project / ReaLHF
  Super-Efficient RLHF Training of LLMs with Parameter Reallocation
  ☆205Updated 2 weeks ago
• RUCAIBox / Slow_Thinking_with_LLMs
  A series of technical report on Slow Thinking with LLM
  ☆359Updated this week
• HarderThenHarder / RLLoggingBoard
  A visuailzation tool to make deep understaning and easier debugging for RLHF training.
  ☆129Updated 3 weeks ago
• SparkJiao / llama-pipeline-parallel
  A prototype repo for hybrid training of pipeline parallel and distributed data parallel with comments on core code snippets. Feel free to…
  ☆53Updated last year
• IronBeliever / CaR
  Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation
  ☆73Updated 2 months ago
• yanqiangmiffy / how-to-train-tokenizer
  怎么训练一个LLM分词器
  ☆138Updated last year
• Outsider565 / LoRA-GA
  ☆171Updated 3 months ago
• sail-sg / regmix
  🧬 RegMix: Data Mixture as Regression for Language Model Pre-training
  ☆99Updated 3 months ago
• genggui001 / Megatron-DeepSpeed-Llama
  ☆84Updated last year
• dvlab-research / Step-DPO
  Implementation for "Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs"
  ☆335Updated last week
• morecry / CharacterEval
  ☆209Updated 2 months ago
• keezen / ntk_alibi
  NTK scaled version of ALiBi position encoding in Transformer.
  ☆67Updated last year
• pldlgb / nuggets
  ☆78Updated last year
• pengr / LLM-Synthetic-Data
  Real-time updated, fine-grained reading list on LLM-synthetic-data.🔥
  ☆201Updated this week
• suu990901 / LLaMA-MiLe-Loss
  Code for a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models
  ☆57Updated 7 months ago
• ADaM-BJTU / OpenRFT
  OpenRFT: Adapting Reasoning Foundation Model for Domain-specific Tasks with Reinforcement Fine-Tuning
  ☆95Updated last month
• boson-ai / RPBench-Auto
  An automated pipeline for evaluating LLMs for role-playing.
  ☆156Updated 4 months ago