Alternatives and similar repositories for qwen2_moe_mergekit:

Users that are interested in qwen2_moe_mergekit are comparing it to the libraries listed below

• akaihaoshuai / baby-llama2-chinese_cybertron
  使用单个24G显卡，从0开始训练LLM
  ☆53Updated 6 months ago
• yuanzhoulvpi2017 / SentenceEmbedding
  ☆109Updated 9 months ago
• linjh1118 / Llama3-Chinese-ORPO
  基于Llama3，通过进一步CPT，SFT，ORPO得到的中文版Llama3
  ☆17Updated last year
• hhnqqq / GemmaLongText
  ☆16Updated last year
• yanqiangmiffy / how-to-train-tokenizer
  怎么训练一个LLM分词器
  ☆144Updated last year
• IronBeliever / CaR
  Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation
  ☆78Updated 5 months ago
• hengjiUSTC / learn-llm
  ☆107Updated 5 months ago
• Glanvery / LLM-Travel
  欢迎来到 "LLM-travel" 仓库！探索大语言模型（LLM）的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。
  ☆316Updated 9 months ago
• genggui001 / Megatron-DeepSpeed-Llama
  ☆84Updated last year
• CSHaitao / ChatGLM_mutli_gpu_tuning
  deepspeed+trainer简单高效实现多卡微调大模型
  ☆124Updated last year
• taishan1994 / sentencepiece_chinese_bpe
  使用sentencepiece中BPE训练中文词表，并在transformers中进行使用。
  ☆117Updated last year
• suu990901 / LLaMA-MiLe-Loss
  Code for a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models
  ☆62Updated 2 months ago
• zexuanqiu / CLongEval
  CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models
  ☆40Updated last year
• firechecking / CleanTransformer
  an implementation of transformer, bert, gpt, and diffusion models for learning purposes
  ☆154Updated 6 months ago
• sugarandgugu / Simple-Trl-Training
  基于DPO算法微调语言大模型，简单好上手。
  ☆37Updated 9 months ago
• liuqidong07 / MOELoRA-peft
  [SIGIR'24] The official implementation code of MOELoRA.
  ☆160Updated 9 months ago
• taishan1994 / Llama3.1-Finetuning
  对llama3进行全参微调、lora微调以及qlora微调。
  ☆193Updated 6 months ago
• YueZhengMeng / MyLlama
  手搓Llama，个人学习用
  ☆14Updated 11 months ago
• git-cloner / Llama2-chinese
  Llama2 chinese finetuning
  ☆38Updated last year
• maidacundo / MoE-LoRA
  Adapt an LLM model to a Mixture-of-Experts model using Parameter Efficient finetuning (LoRA), injecting the LoRAs in the FFN.
  ☆33Updated 6 months ago
• OpenMOSS / HalluQA
  Dataset and evaluation script for "Evaluating Hallucinations in Chinese Large Language Models"
  ☆124Updated 10 months ago
• ssbuild / qwen_finetuning
  qwen models finetuning
  ☆97Updated last month
• zejunwang1 / LLMTuner
  大语言模型指令调优工具（支持 FlashAttention）
  ☆172Updated last year
• heyblackC / BetterMixture-Top1-Solution
  天池算法比赛《BetterMixture - 大模型数据混合挑战赛》的第一名top1解决方案
  ☆30Updated 9 months ago
• NEU-DataMining / PICA
  多轮共情对话模型PICA
  ☆92Updated last year
• yongzhuo / qwen2-sft
  Qwen1.5-SFT(阿里, Ali), Qwen_Qwen1.5-2B-Chat/Qwen_Qwen1.5-7B-Chat微调(transformers)/LORA(peft)/推理
  ☆57Updated 11 months ago
• OpenBMB / UltraEval
  [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.
  ☆240Updated 5 months ago
• CASIA-LM / MoDS
  ☆140Updated last year
• muyaostudio / qwen2_seq_cls
  使用 Qwen2ForSequenceClassification 简单实现文本分类任务。
  ☆59Updated 10 months ago
• beichao1314 / Open-Llama
  The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.
  ☆65Updated 2 years ago