使用deepspeed从头开始训练一个LLM,经过pretrain和sft阶段,验证llm学习知识、理解语言、回答问题的能力
☆162Oct 13, 2025Updated 5 months ago
Alternatives and similar repositories for Train-llm-from-scratch
Users that are interested in Train-llm-from-scratch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- kight is a static analysis tool for c/c++ programs.☆214Dec 27, 2024Updated last year
- Official Implementation of AttentionShift: Iteratively Estimated Part-based Attention Map for Pointly Supervised Instance Segmentation☆155Oct 18, 2024Updated last year
- An Workspace for HMI tools☆164Jul 11, 2024Updated last year
- ☆247Nov 24, 2024Updated last year
- Evaluation of Text-to-Video Generation Models: A Dynamics Perspective[NeurIPS 2024].☆274Dec 3, 2024Updated last year
- ☆142May 8, 2024Updated last year
- Advanced Unsupervised Image Enhancement with GAN☆247Nov 11, 2024Updated last year
- An awesome list of self-sovereign identity resources.☆138Jul 9, 2024Updated last year
- 莫甘娜问卷表单编辑器，低代码快速搭建表单，AI表单 生成，表单数据搜集统计☆147Aug 9, 2024Updated last year
- YiTu is an easy-to-use runtime to fully exploit the hybrid parallelism of different hardwares (e.g., GPU) to efficiently support the exec…☆254Jan 7, 2026Updated 2 months ago
- Deep Reinforcement Learning Algorithms for solving Atari 2600 Games☆143Mar 23, 2023Updated 3 years ago
- Book Recommendation System☆235May 2, 2024Updated last year
- 一个轻量的企业级BFF框架，集成xprofiler能力，可直接使用其强大的监控告警能力。☆265Feb 7, 2024Updated 2 years ago
- 🔗 Serverless blockchain analytics pipeline on AWS - Extract, process and visualize Ethereum data using Kinesis, Lambda, Redshift Serverl…☆103Oct 5, 2023Updated 2 years ago
- ☆252Feb 11, 2025Updated last year
- ☆242Jul 5, 2024Updated last year
- ☆176Feb 21, 2025Updated last year
- Inscriptions on CoreDao, powered by Insdexer.☆148Mar 20, 2024Updated 2 years ago
- This project features optimized Go language, expert source code, concurrent processing, and industry-best practices.☆142Mar 14, 2023Updated 3 years ago
- A python package that integrate algorithms and various machine learning approaches to extract features (genes) effective for classificati…☆252Jan 15, 2026Updated 2 months ago
- Welcome to the 'Open-Alteryx-Macro' project. This project is aimed at providing an open-source solution for managing and updating Alteryx…☆156May 25, 2024Updated last year
- Large-Scale Selfie Video Dataset (L-SVD): A Benchmark for Emotion Recognition☆306Aug 18, 2024Updated last year
- ☆143May 25, 2024Updated last year
- Visualization, simulation, manipulation of Intrinsically disorder proteins with Gibbs sampling☆288Oct 24, 2024Updated last year
- Code for paper "Self-Taught Recognizer: Toward Unsupervised Adaptation for Speech Foundation Models"☆242May 24, 2024Updated last year
- A code repository designed to show the best GitHub has to offer.☆165Jun 30, 2024Updated last year
- ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Code (https://arxiv.org/abs/2311.098…☆318Jul 31, 2025Updated 7 months ago
- An extension for Visual Studio Code that integrates the power of OpenAI's GPT models into VSCode.☆160Mar 24, 2024Updated last year
- R package for autoregressive, reduced-rank, and factor models in time series.☆122Mar 3, 2025Updated last year
- ☆142Nov 13, 2024Updated last year
- ☆287Jul 6, 2024Updated last year
- An open-source library with a powerful Contrastive Language-and-Motion (CLaM) pre-training evaluator☆97Nov 23, 2025Updated 4 months ago
- ☆297Sep 14, 2025Updated 6 months ago
- 网络硬盘是通过存储、分类、检索、分享、协作、下发、回收、展示等方式管理文档、文件、图片、音频、视频等资料的工具。网络硬盘擅长在国产的私有化环境中管控文档权限、存储空间分配、安全加密、链接分享，同时支持一定轻量级的文件任务收发。网络硬盘需要依赖开源的数字底座进行人员岗位管控。☆353Mar 16, 2026Updated last week
- Decentralized, account-centric programmable indexing network for web3. Supports blockchain explorers, on-chain portfolios, social graphs,…☆143Oct 22, 2025Updated 5 months ago
- Build a simple yet effective CNN to work as a sketch recognizer. Just like Google Quick-Draw Project.☆143Mar 23, 2023Updated 3 years ago
- A curated list of awesome papers related to adversarial attacks and defenses for information retrieval. If I missed any papers, feel free…☆221Jul 11, 2024Updated last year
- Simple yet powerful Twitter data retrieval SDK with multi-language support.No Limits, No Auth Required☆183Jan 6, 2025Updated last year
- User Identity Scaffolding for Multiple OIDC Authentications for User☆95Jun 14, 2025Updated 9 months ago