akaihaoshuai / baby-llama2-chinese_cybertron

Related projects ⓘ

Alternatives and complementary repositories for baby-llama2-chinese_cybertron

• yanqiangmiffy / how-to-train-tokenizer
  怎么训练一个LLM分词器
  ☆129Updated last year
• hengjiUSTC / learn-llm
  ☆85Updated last week
• yuanzhoulvpi2017 / SentenceEmbedding
  ☆88Updated 4 months ago
• CASIA-LM / MoDS
  ☆120Updated 7 months ago
• sugarandgugu / Simple-Trl-Training
  基于DPO算法微调语言大模型，简单好上手。
  ☆28Updated 4 months ago
• zejunwang1 / LLMTuner
  大语言模型指令调优工具（支持 FlashAttention）
  ☆166Updated 10 months ago
• DA-southampton / RedGPT
  ☆62Updated last year
• Mxoder / LLM-from-scratch
  一些 LLM 方面的从零复现笔记
  ☆137Updated 2 months ago
• Glanvery / LLM-Travel
  欢迎来到 "LLM-travel" 仓库！探索大语言模型（LLM）的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。
  ☆267Updated 4 months ago
• CSHaitao / ChatGLM_mutli_gpu_tuning
  deepspeed+trainer简单高效实现多卡微调大模型
  ☆116Updated last year
• zhangzhao219 / WSDM-Cup-2024
  1st Solution For Conversational Multi-Doc QA Workshop & International Challenge @ WSDM'24 - Xiaohongshu.Inc
  ☆155Updated 8 months ago
• dawoshi / Tianchi-LLM-QA
  阿里天池: 2023全球智能汽车AI挑战赛——赛道一：AI大模型检索问答 baseline 80+
  ☆76Updated 10 months ago
• zhanshijinwat / Steel-LLM
  Train a 1B LLM with 1T tokens from scratch by personal
  ☆319Updated this week
• IronBeliever / CaR
  Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation
  ☆67Updated last week
• ArtificialZeng / Baichuan2-Explained
  Baichuan2代码的逐行解析版本，适合小白
  ☆208Updated last year
• Sshuoshuo / easy-rag
  快速入门RAG与私有化部署
  ☆131Updated 7 months ago
• BUAADreamer / EasyRAG
  Easy-to-Use RAG Framework; CCF AIOps International Challenge 2024 Top3 Solution; CCF AIOps 国际挑战赛 2024 季军方案
  ☆127Updated this week
• xv44586 / Chinese-instruction-datasets
  中文 Instruction tuning datasets
  ☆118Updated 7 months ago
• tianyi-lab / Cherry_LLM
  [NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other mo…
  ☆307Updated 2 months ago
• stanleylsx / llms_tool
  一个基于HuggingFace开发的大语言模型训练、测试工具。支持各模型的webui、终端预测，低参数量及全参数模型训练(预训练、SFT、RM、PPO、DPO)和融合、量化。
  ☆204Updated 11 months ago
• tjunlp-lab / M3KE
  A Massive Multi-Level Multi-Subject Knowledge Evaluation benchmark
  ☆99Updated last year
• sufengniu / RefGPT
  ☆157Updated last year
• Pillars-Creation / ChatGLM-RLHF-LoRA-RM-PPO
  ChatGLM-6B添加了RLHF的实现，以及部分核心代码的逐行讲解 ,实例部分是做了个新闻短标题的生成，以及指定context推荐的RLHF的实现
  ☆78Updated last year
• git-cloner / llama2-lora-fine-tuning
  llama2 finetuning with deepspeed and lora
  ☆167Updated last year
• lansinuote / Simple_LLM_PPO
  ☆37Updated 3 months ago
• taishan1994 / Llama3.1-Finetuning
  对llama3进行全参微调、lora微调以及qlora微调。
  ☆152Updated last month
• l294265421 / alpaca-rlhf
  Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat
  ☆106Updated last year
• CASIA-LM / ChineseWebText
  ☆158Updated last year
• taishan1994 / sentencepiece_chinese_bpe
  使用sentencepiece中BPE训练中文词表，并在transformers中进行使用。
  ☆110Updated last year
• yongzhuo / LLM-SFT
  中文大模型微调(LLM-SFT), 数学指令数据集MWP-Instruct, 支持模型(ChatGLM-6B, LLaMA, Bloom-7B, baichuan-7B), 支持(LoRA, QLoRA, DeepSpeed, UI, TensorboardX), 支持(微…
  ☆168Updated 6 months ago