从0开始,将chatgpt的技术路线跑一遍。
☆276Sep 5, 2024Updated last year
Alternatives and similar repositories for Zero-Chatgpt
Users that are interested in Zero-Chatgpt are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 训练一个对中文支持更好的LLaVA模型,并开源训练代码和数据。☆79Sep 6, 2024Updated last year
- 从0到1构建一个MiniLLM (pretrain+sft+dpo实践中)☆541Mar 23, 2025Updated last year
- 从零实现一个小参数量中文大语言模型。☆979Aug 22, 2024Updated last year
- 中文对话0.2B小模型(ChatLM-Chinese-0.2B),开源所有数据集来源、数据清洗、tokenizer训练、模型预训练、SFT指令微调、RLHF优化等流程的全部代码。支持下游任务sft微调,给出三元组信息抽取微调示例。☆1,682Apr 20, 2024Updated last year
- 用于从头预训练+SFT一个小参数量的中文LLaMa2的仓库;24G单卡即可运行得到一个具备简单中文问答能力的chat-llama2.☆2,901May 21, 2024Updated last year
- 想要从零开始训练一个中文的mini大语言模型,可以进行基本的对话,模型大小根据手头的机器决定☆65Aug 14, 2024Updated last year
- Train a 1B LLM with 1T tokens from scratch by personal☆792Apr 27, 2025Updated 10 months ago
- ☆22Jul 15, 2024Updated last year
- This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.☆496May 1, 2025Updated 10 months ago
- Phi2-Chinese-0.2B 从0开始训练自己的Phi2中文小模型,支持接入langchain加载本地知识库做检索增强生成RAG。Training your own Phi2 small chat model from scratch.☆586Jul 11, 2024Updated last year
- Simple MoE - Day 17 of 365 Days of Repos☆17Jan 17, 2025Updated last year
- ☆19Aug 9, 2024Updated last year
- 🚀🚀 「大模型」2小时完全从0训练26M的小参数GPT!🌏 Train a 26M-parameter GPT from scratch in just 2h!☆41,885Feb 6, 2026Updated last month
- 🚀 「大模型」1小时从0训练26M参数的视觉多模态VLM!🌏 Train a 26M-parameter VLM from scratch in just 1 hours!☆6,795Feb 4, 2026Updated last month
- 从零到一实现一个 miniLLM~(动手学习LLM)☆78Apr 30, 2024Updated last year
- Implementation of Prompt-to-Prompt Image Editing with Cross Attention Control☆16Apr 5, 2023Updated 2 years ago
- Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library☆50Aug 20, 2025Updated 7 months ago
- 本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)☆23,641Mar 12, 2026Updated last week
- ☆60Updated this week
- 使用单个24G显卡,从0开始训练LLM☆56Jul 9, 2025Updated 8 months ago
- aigc evals☆10Dec 2, 2023Updated 2 years ago
- 《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调(全参数/Lora)、部署国内外开源大模型(LLM)/多模态大模型(MLLM)教程☆29,053Mar 8, 2026Updated 2 weeks ago
- Implementation of "ACL'24: When Do LLMs Need Retrieval Augmentation? Mitigating LLMs’ Overconfidence Helps Retrieval Augmentation"☆24Jul 19, 2024Updated last year
- 🚀 轻量视频🎥 大模型🤖☆22Apr 27, 2025Updated 10 months ago
- 大模型预训练中文语料清洗及质量评估 Large model pre-training corpus cleaning☆79Jul 25, 2024Updated last year
- pdf multimodal rag 【pdf多模态rag问答】☆27Feb 26, 2025Updated last year
- 《大模型白盒子构建指南》:一个全手搓的Tiny-Universe☆4,619Feb 12, 2026Updated last month
- [WIP@Oct 13] 质衡-基准测试 (Q-Bench in Chinese),包含中文版【底层视觉问答】和【底层视觉描述】数据集,以及中文提示下的图片质量评价。 We will release Q-Bench in more languages in the futu…☆24Jan 7, 2024Updated 2 years ago
- 博客代码:快过年了,搞个AI作曲,用TensorFlow训练midi文件☆17Dec 24, 2022Updated 3 years ago
- 中文nlp解决方案(大模型、数据、模型、训练、推理)☆3,786Aug 5, 2025Updated 7 months ago
- 大模型基础: 一文了解大模型基础知识☆6,936Dec 18, 2025Updated 3 months ago
- 基于DPO算法微调语言大模型,简单好上手。☆51Jul 3, 2024Updated last year
- 一些大语言模型和多模态模型的生态,主要包括跨模态搜索、投机解码、QAT量化、多模态量化、ChatBot、OCR☆196Jan 30, 2026Updated last month
- An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & TIS & vLLM & Ray & Async RL)☆9,191Mar 16, 2026Updated last week
- [EMNLP2023]: MIRACLE: Towards Personalized Dialogue Generation with Latent-Space Multiple Personal Attribute Control☆12Nov 11, 2023Updated 2 years ago
- The source code of "Improved Graph Contrastive Learning for Short Text Classification"☆12Aug 14, 2025Updated 7 months ago
- ☆29Sep 29, 2024Updated last year
- LLM Inference via Triton (Flexible & Modular): Focused on Kernel Optimization using CUBIN binaries, Starting from gpt-oss Model☆79Updated this week
- Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang☆61Nov 8, 2024Updated last year