wdndev / llama3-from-scratch-zh

Related projects ⓘ

Alternatives and complementary repositories for llama3-from-scratch-zh

• datawhalechina / tiny-universe
  《大模型白盒子构建指南》：一个全手搓的Tiny-Universe
  ☆1,363Updated 3 weeks ago
• ArronAI007 / Awesome-AGI
  AGI资料汇总学习（主要包括LLM和AIGC），持续更新......
  ☆307Updated 3 weeks ago
• modelscope / modelscope-classroom
  ☆506Updated 2 weeks ago
• wdndev / tiny-llm-zh
  从零实现一个小参数量中文大语言模型。
  ☆279Updated 2 months ago
• liguodongiot / llm-resource
  LLM全栈优质资源汇总
  ☆368Updated 2 months ago
• SmartFlowAI / Llama3-Tutorial
  Llama3-Tutorial（XTuner、LMDeploy、OpenCompass）
  ☆492Updated 6 months ago
• owenliang / qwen-vllm
  通义千问VLLM推理部署DEMO
  ☆443Updated 7 months ago
• datawhalechina / llms-from-scratch-cn
  仅需Python基础，从0构建大语言模型；从0逐步构建GLM4\Llama3\RWKV6， 深入理解大模型原理
  ☆1,558Updated 3 months ago
• Tongjilibo / build_MiniLLM_from_scratch
  从0到1构建一个MiniLLM (pretrain+sft+dpo实践中)
  ☆329Updated 2 months ago
• kebijuelun / Awesome-LLM-Learning
  Learning Large Language Model (LLM）(大语言模型学习)
  ☆341Updated 7 months ago
• KMnO4-zx / TinyRAG
  TinyRAG
  ☆235Updated 3 weeks ago
• charent / Phi2-mini-Chinese
  Phi2-Chinese-0.2B 从0开始训练自己的Phi2中文小模型，支持接入langchain加载本地知识库做检索增强生成RAG。Training your own Phi2 small chat model from scratch.
  ☆488Updated 4 months ago
• charent / ChatLM-mini-Chinese
  中文对话0.2B小模型（ChatLM-Chinese-0.2B），开源所有数据集来源、数据清洗、tokenizer训练、模型预训练、SFT指令微调、RLHF优化等流程的全部代码。支持下游任务sft微调，给出三元组信息抽取微调示例。
  ☆1,246Updated 7 months ago
• jingyaogong / minimind-v
  「大模型」3小时从0训练27M参数的视觉多模态VLM，个人显卡即可推理训练！
  ☆365Updated this week
• MetaGLM / glm-cookbook
  Examples and guides for using the GLM APIs
  ☆806Updated last week
• zhanshijinwat / Steel-LLM
  Train a 1B LLM with 1T tokens from scratch by personal
  ☆319Updated this week
• SmartFlowAI / EmoLLM
  心理健康大模型、LLM、The Big Model of Mental Health、Finetune、InternLM2、InternLM2.5、Qwen、ChatGLM、Baichuan、DeepSeek、Mixtral、LLama3、GLM4、Qwen2、LLama3…
  ☆859Updated 3 weeks ago
• intro-llm / intro-llm.github.io
  website
  ☆372Updated last month
• NLPJCL / RAG-Retrieval
  Unify Efficient Fine-tuning of RAG Retrieval, including Embedding, ColBERT, ReRanker.
  ☆511Updated last week
• Tongyi-EconML / FinQwen
  FinQwen: 致力于构建一个开放、稳定、高质量的金融大模型项目，基于大模型搭建金融场景智能问答系统，利用开源开放来促进「AI+金融」。
  ☆303Updated 5 months ago
• jiahe7ay / MINI_LLM
  This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.
  ☆353Updated 6 months ago
• seanzhang-zhichen / llama3-chinese
  Llama3-Chinese是以Meta-Llama-3-8B为底座，使用 DORA + LORA+ 的训练方法，在50w高质量中文多轮SFT数据 + 10w英文多轮SFT数据 + 2000单轮自我认知数据训练而来的大模型。
  ☆289Updated 6 months ago
• lizhe2004 / Awesome-LLM-RAG-Application
  the resources about the application based on LLM with RAG pattern
  ☆872Updated 2 months ago
• waylandzhang / Transformer-from-scratch
  ☆266Updated 6 months ago
• AI-Study-Han / Zero-Chatgpt
  从0开始，将chatgpt的技术路线跑一遍。
  ☆152Updated 2 months ago
• datawhalechina / agent-tutorial
  ☆178Updated 8 months ago
• KMnO4-zx / huanhuan-chat
  Chat-甄嬛是利用《甄嬛传》剧本中所有关于甄嬛的台词和语句，基于ChatGLM2进行LoRA微调得到的模仿甄嬛语气的聊天语言模型。
  ☆510Updated 2 months ago
• InternLM / Tutorial
  LLM&VLM Tutorial
  ☆1,534Updated this week
• RUCAIBox / LLMBox
  A comprehensive library for implementing LLMs, including a unified training pipeline and comprehensive model evaluation.
  ☆633Updated this week
• mst272 / LLM-Dojo
  欢迎来到 LLM-Dojo，这里是一个开源大模型学习场所，使用简洁且易阅读的代码构建模型训练框架(支持各种主流模型如Qwen、Llama、GLM等等)、RLHF框架(DPO/CPO/KTO/PPO)等各种功能。👩‍🎓👨‍🎓
  ☆347Updated last week