使用单个24G显卡，从0开始训练LLM
☆54Jul 9, 2025Updated last year
Alternatives and similar repositories for baby-llama2-chinese_cybertron
Users that are interested in baby-llama2-chinese_cybertron are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 目标：构建一个更符合语言学的小而美的 llama 分词器，支持中英日三国语言☆19Jun 2, 2024Updated 2 years ago
- 怎么训练一个LLM分词器☆152Jul 13, 2023Updated 3 years ago
- 用于从头预训练+SFT一个小参数量的中文LLaMa2的仓库；24G单卡即可运行得到一个具备简单中文问答能力的chat-llama2.☆2,921Updated this week
- ☆45Aug 9, 2024Updated 2 years ago
- This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.☆504May 1, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆14Mar 28, 2025Updated last year
- AdaptiveStep: Automatically Dividing Reasoning Step through Model Confidence☆10Mar 2, 2025Updated last year
- LLM+RAG for QA☆23Jan 15, 2024Updated 2 years ago
- WisdoMentor - Series: A LLM for undergraduates | 博导智言(辅助大学生 学习)☆13May 9, 2024Updated 2 years ago
- Evaluation repository of wikipedia index with Dria☆10Mar 14, 2024Updated 2 years ago
- macrogpt大模型全量预训练(1b3,32层), 多卡deepspeed/单卡adafactor☆15Nov 30, 2023Updated 2 years ago
- Phi2-Chinese-0.2B 从0开始训练自己的Phi2中文小模型，支持接入langchain加载本地知识库做检索增强生成RAG。Training your own Phi2 small chat model from scratch.☆591Jul 11, 2024Updated 2 years ago
- Implementation of Implicit Graphon Neural Representation☆13Sep 1, 2023Updated 2 years ago
- To assess the longtext capabilities more comprehensively, we propose Needle-in-a-Haystack PLUS, which shifts the focus from simple fact r…☆13Mar 4, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code repository for the WWW 2019 paper "Predicting ConceptNet Path Quality Using Crowdsourced Assessments of Naturalness"☆12Feb 1, 2019Updated 7 years ago
- 中文对话0.2B小模型（ChatLM-Chinese-0.2B），开源所有数据集来源、数据清洗、tokenizer训练、模型预训练、SFT指令微调、RLHF优化等流程的全部代码。支持下游任务sft微调，给出三元组信息抽取微调示例。☆1,724Apr 20, 2024Updated 2 years ago
- [ICLR 2024] Towards Robust Multi-Modal Reasoning via Model Selection☆14Mar 7, 2024Updated 2 years ago
- IJCNN 2021: Inductive Learning on Commonsense Knowledge Graph Completion (Depreciated)☆15Nov 13, 2023Updated 2 years ago
- Repo for paper: Examining LLMs' Uncertainty Expression Towards Questions Outside Parametric Knowledge☆14Feb 20, 2024Updated 2 years ago
- DCPO: Dynamic Adaptive Clipping for RL☆49Apr 1, 2026Updated 4 months ago
- Implementation of the Influence Maximization Benchmarker (IMB)☆14Aug 10, 2023Updated 3 years ago
- AI Hedge Fund Repo integrate with DeepSeek V3 and R1 hosted on SiliconFlow.☆12Feb 3, 2025Updated last year
- Dataset containing Semantic Relations and Metadata, for Training and Evaluating Distributional Semantic Models in English and Mandarin Ch…☆16Aug 7, 2017Updated 9 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 🔥 How to efficiently and effectively compress the CoTs or directly generate concise CoTs during inference while maintaining the reasonin…☆65May 22, 2025Updated last year
- Meta-learning-based Cold-Start Sequential Recommendation☆16May 25, 2021Updated 5 years ago
- An implementation of a HMM Ngram language model.☆10Mar 12, 2015Updated 11 years ago
- Programming for NLP Project - Implement a basic n-gram language model and generate sentence using beam search☆11Mar 10, 2020Updated 6 years ago
- 本项目采用BERT等预训练模型实现多项选择型阅读理解任务（Multiple Choice MRC）☆16Jun 20, 2021Updated 5 years ago
- Code and dataset for the ICLR 2024 paper "Thought Propagation: An analogical Approach to Complex Reasoning with Large Language Models."☆17Mar 4, 2024Updated 2 years ago
- 基于cn-clip模型封装的本地图片搜索工具☆11Jul 6, 2023Updated 3 years ago
- Here is my implementation of Center Loss with Keras☆11May 2, 2018Updated 8 years ago
- 基于自由度（熵）、凝固度 新词发现算法实现☆12Oct 7, 2018Updated 7 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆15Jan 9, 2022Updated 4 years ago
- a simple new ISA nnISA and nnSOC nnCPU nnAs nnCc☆10Mar 15, 2020Updated 6 years ago
- Awesome papers, datasets and projects about the study of large language models like GPT-3, GPT-3.5, ChatGPT, GPT-4, etc.☆20Jun 10, 2023Updated 3 years ago
- ☆16Mar 30, 2023Updated 3 years ago
- The smallest 6502 / NES CPU simulator in JS (944b gzipped)☆15Mar 1, 2022Updated 4 years ago
- [ACL 2024] Implementation for Advancing Abductive Reasoning in Knowledge Graphs through Complex Logical Hypothesis Generation☆15Oct 9, 2025Updated 10 months ago
- Notebooks for 6.S088 IAP 2023☆16Aug 1, 2024Updated 2 years ago