Alternatives and similar repositories for LLM-Pretrain-SFT

Users that are interested in LLM-Pretrain-SFT are comparing it to the libraries listed below

• IronBeliever / CaR
  Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation
  ☆77Updated 6 months ago
• Spico197 / Humpback
  🐋 An unofficial implementation of Self-Alignment with Instruction Backtranslation.
  ☆139Updated last week
• CASIA-LM / MoDS
  ☆140Updated last year
• tianyi-lab / Superfiltering
  [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning
  ☆151Updated 8 months ago
• l294265421 / alpaca-rlhf
  Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat
  ☆115Updated last year
• yanqiangmiffy / how-to-train-tokenizer
  怎么训练一个LLM分词器
  ☆144Updated last year
• zexuanqiu / CLongEval
  CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models
  ☆40Updated last year
• chen700564 / RGB
  ☆314Updated last year
• OFA-Sys / InsTag
  InsTag: A Tool for Data Analysis in LLM Supervised Fine-tuning
  ☆258Updated last year
• mutonix / RefGPT
  ☆97Updated last year
• tianyi-lab / Cherry_LLM
  [NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other mo…
  ☆365Updated 8 months ago
• thu-coai / CritiqueLLM
  ☆143Updated 10 months ago
• thu-coai / ComplexBench
  Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)
  ☆82Updated 2 months ago
• 5663015 / LLMs_train
  一套代码指令微调大模型
  ☆39Updated last year
• cavalierlulu / rag_survey
  ☆123Updated last year
• WhereIsAI / BiLLM
  Tool for converting LLMs from uni-directional to bi-directional by removing causal mask for tasks like classification and sentence embedd…
  ☆58Updated 5 months ago
• OpenMOSS / HalluQA
  Dataset and evaluation script for "Evaluating Hallucinations in Chinese Large Language Models"
  ☆126Updated 11 months ago
• ssbuild / llm_finetuning
  Large language Model fintuning bloom , opt , gpt, gpt2 ,llama,llama-2,cpmant and so on
  ☆97Updated last year
• beichao1314 / Open-Llama
  The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.
  ☆65Updated 2 years ago
• yegcjs / mixinglaws
  ☆98Updated 7 months ago
• ACL2023-Retrieval-LM / ACL2023-Retrieval-LM.github.io
  https://acl2023-retrieval-lm.github.io/
  ☆153Updated last year
• princeton-nlp / CEPE
  [ACL 2024] Long-Context Language Modeling with Parallel Encodings
  ☆153Updated 11 months ago
• MikeGu721 / EasyLLM
  make LLM easier to use
  ☆59Updated last year
• sugarandgugu / Simple-Trl-Training
  基于DPO算法微调语言大模型，简单好上手。
  ☆37Updated 10 months ago
• OpenMatch / Augmentation-Adapted-Retriever
  [ACL 2023] This is the code repo for our ACL'23 paper "Augmentation-Adapted Retriever Improves Generalization of Language Models as Gener…
  ☆60Updated 10 months ago
• yangjianxin1 / LongQLoRA
  LongQLoRA: Extent Context Length of LLMs Efficiently
  ☆165Updated last year
• thu-coai / AutoDetect
  Official github repo for AutoDetect, an automated weakness detection framework for LLMs.
  ☆42Updated 10 months ago
• hkust-nlp / deita
  Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]
  ☆554Updated 5 months ago
• xbmxb / RAG-query-rewriting
  ☆179Updated last year
• kongds / scaling_sentemb
  Scaling Sentence Embeddings with Large Language Models
  ☆107Updated last year