使用单个24G显卡，从0开始训练LLM
☆54Jul 9, 2025Updated last year
Alternatives and similar repositories for baby-llama2-chinese_cybertron
Users that are interested in baby-llama2-chinese_cybertron are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 想要从零开始训练一个中文的mini大语言模型，可以进行基本的对话，模型大小根据手头的机器决定☆66Aug 14, 2024Updated 2 years ago
- 目标：构建一个更符合语言学的小而美的 llama 分词器，支持中英日三国语言☆19Jun 2, 2024Updated 2 years ago
- 怎么训练一个LLM分词器☆152Jul 13, 2023Updated 3 years ago
- ☆15Aug 21, 2023Updated 3 years ago
- 用于从头预训练+SFT一个小参数量的中文LLaMa2的仓库；24G单卡即可运行得到一个具备简单中文问答能力的chat-llama2.☆2,922Aug 13, 2026Updated 3 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆45Aug 9, 2024Updated 2 years ago
- This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.☆504May 1, 2025Updated last year
- LLM+RAG for QA☆23Jan 15, 2024Updated 2 years ago
- 基于Llama3，通过进一步CPT，SFT，ORPO得到的中文版Llama3☆16Apr 24, 2024Updated 2 years ago
- macrogpt大模型全量预训练(1b3,32层), 多卡deepspeed/单卡adafactor☆15Nov 30, 2023Updated 2 years ago
- Phi2-Chinese-0.2B 从0开始训练自己的Phi2中文小模型，支持接入langchain加载本地知识库做检索增强生成RAG。Training your own Phi2 small chat model from scratch.☆591Jul 11, 2024Updated 2 years ago
- onebot v11 adapter in plugin☆10Mar 5, 2023Updated 3 years ago
- ☆10Dec 10, 2023Updated 2 years ago
- Implementation of Implicit Graphon Neural Representation☆13Sep 1, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A distributed, extensible, secure solution for evaluating machine generated code with unit tests in multiple programming languages.☆64Oct 21, 2024Updated last year
- To assess the longtext capabilities more comprehensively, we propose Needle-in-a-Haystack PLUS, which shifts the focus from simple fact r…☆13Mar 4, 2024Updated 2 years ago
- Code repository for the WWW 2019 paper "Predicting ConceptNet Path Quality Using Crowdsourced Assessments of Naturalness"☆12Feb 1, 2019Updated 7 years ago
- Example code from Parallel Programming in C with MPI and OpenMP☆11Feb 24, 2021Updated 5 years ago
- 中文对话0.2B小模型（ChatLM-Chinese-0.2B），开源所有数据集来源、数据清洗、tokenizer训练、模型预训练、SFT指令微调、RLHF优化等流程的全部代码。支持下游任务sft微调，给出三元组信息抽取微调示例。☆1,731Apr 20, 2024Updated 2 years ago
- [ACL 2026] A large-scale longitudinal study on robust and fair evaluation of LLMs — 200K+ generative questions across 13 disciplines☆41May 21, 2026Updated 3 months ago
- Matrix Product State algorithm for computing characters of the symmetric group S_n☆11Sep 26, 2025Updated 11 months ago
- 基于pytorch的不平衡数据的文本分类☆12Dec 26, 2021Updated 4 years ago
- Xcbwin - a simple C++ class for graphical outputs using XCB☆12May 12, 2015Updated 11 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [ICLR 2024] Towards Robust Multi-Modal Reasoning via Model Selection☆14Mar 7, 2024Updated 2 years ago
- IJCNN 2021: Inductive Learning on Commonsense Knowledge Graph Completion (Depreciated)☆15Nov 13, 2023Updated 2 years ago
- Repo for paper: Examining LLMs' Uncertainty Expression Towards Questions Outside Parametric Knowledge☆14Feb 20, 2024Updated 2 years ago
- In this project, I explore some typical value-based and policy-based RL algorithms. I do experiments on DQN and its six variants and thei…☆12Nov 18, 2020Updated 5 years ago
- DCPO: Dynamic Adaptive Clipping for RL☆50Apr 1, 2026Updated 5 months ago
- ☆17May 23, 2023Updated 3 years ago
- Implementation of the Influence Maximization Benchmarker (IMB)☆14Aug 10, 2023Updated 3 years ago
- Thin wrapper for the AllenNLP's implementation of supervised open information extraction☆17Nov 19, 2019Updated 6 years ago
- aigc evals☆10Dec 2, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Dataset containing Semantic Relations and Metadata, for Training and Evaluating Distributional Semantic Models in English and Mandarin Ch…☆17Aug 7, 2017Updated 9 years ago
- ☆17Jan 14, 2026Updated 7 months ago
- ☆11May 27, 2020Updated 6 years ago
- 🔥 How to efficiently and effectively compress the CoTs or directly generate concise CoTs during inference while maintaining the reasonin…☆65May 22, 2025Updated last year
- An implementation of a HMM Ngram language model.☆10Mar 12, 2015Updated 11 years ago
- Dynamic data selection for neural machine translation☆20Jan 28, 2018Updated 8 years ago
- 本项目采用BERT等预训练模型实现多项选择型阅读理解任务（Multiple Choice MRC）☆16Jun 20, 2021Updated 5 years ago