一个手把手教你从零开始编写GPT并训练大语言模型的教程
☆102Jan 20, 2025Updated last year
Alternatives and similar repositories for ScratchLLMStepByStep
Users that are interested in ScratchLLMStepByStep are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 从零开始学大模型Transformer、GPT2、BERT pre-training and fine-tuning from scratch☆41Jul 1, 2024Updated 2 years ago
- 该系列的目的是让读者可以在基础的pytorch上，不依赖任何其他现成的外部库，从零开始理解并实现一个大语言模型的所有组成部分，以及训练微调代码，因此读者仅需python，pytorch和最基础深度学习背景知识即可。☆385Aug 28, 2025Updated last year
- A GPT-2 inference engine written from scratch in CUDA and C++. Implements custom CUDA kernels for tiled matrix multiplication, LayerNorm,…☆44May 17, 2026Updated 5 months ago
- Advanced implementation of DeepSeek-R1 featuring Group Relative Policy Optimization (GRPO) for mathematical reasoning AI. Integrates safe…☆13Jan 29, 2025Updated last year
- 本项目旨在利用LangChain和大语言模型（如ZhipuAI）开发一个智能数据库问答系统。 该系统能够通过自然语言理解用户的查询请求，自动生成相应的SQL语句并执行，最后将查询结果以自然语言 形式返回用户。☆15Jul 31, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆20Apr 11, 2024Updated 2 years ago
- Agentic RL 中文零基础教程（33 章）：从概念到 GRPO 实战，含 TRL 最小可跑示例；26–33 章附一套可运行的三方判别模型实证工程（encoder vs LLM-LoRA vs 规则基线）。第 25 章讲清 Jev / TypeSafe System O…☆128Updated this week
- 介绍用 golang 编写 Ansible 插件☆16Aug 30, 2018Updated 8 years ago
- 强化学习原理 + 强化学习代码实现 + 强化学习框架 + 强化学习论文☆37Updated this week
- Blindspots in LLMs I've noticed while AI coding. Sonnet family emphasis.☆13Mar 20, 2025Updated last year
- Extract from SU2☆17Aug 19, 2019Updated 7 years ago
- Kexplain is an interactive kubectl explain☆12Oct 23, 2023Updated 2 years ago
- real time recommendation playground☆15Nov 7, 2022Updated 3 years ago
- Go和大语言模型编程☆43Mar 5, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Production-grade memory layer for AI agents with durable multi-tenant memory, semantic recall, async distillation, and SDK/Gateway integr…☆180Sep 29, 2026Updated 2 weeks ago
- The PyPrepar3D project aims to provide a high level python api to Lockeed Martin´s Prepar3D SDK. The Docuentation for the C/C++ SDK can b…☆11Dec 3, 2015Updated 10 years ago
- Explore and express your inner voice through personalized conversations with HeartEcho, a platform dedicated to understanding and evolvin…☆25Aug 16, 2024Updated 2 years ago
- ☆11Dec 29, 2020Updated 5 years ago
- Demo on how to write your own `kubectl exec` command with client-go☆13May 15, 2017Updated 9 years ago
- You can download winhex and its crack patch here☆12Sep 12, 2019Updated 7 years ago
- https://www.kaggle.com/c/bengaliai-cv19/leaderboard☆12Oct 3, 2023Updated 3 years ago
- Rust driver for the Semtec SX128x series of 2.4GHz LoRa/ISM radio transceivers☆18Apr 18, 2024Updated 2 years ago
- ☆11Sep 29, 2021Updated 5 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- 个人在Claude学习写卡的笔记,包含ST角色卡编写，世界书，AI输出理解，破限相关内容☆16Nov 1, 2024Updated last year
- Semantic-decoupled Spatial Partition Guided Point-supervised Oriented Object Detection☆13Jul 7, 2026Updated 3 months ago
- useful cuda code .☆44Mar 11, 2022Updated 4 years ago
- Visualizing ingredient pairings and properties as described in the Flavor Bible☆17Jul 30, 2020Updated 6 years ago
- The scheduler of Volcano, built based on kubernetes-sigs/kube-batch☆14Jul 7, 2019Updated 7 years ago
- Last place solutioin to fastMRI Image Reconstruction Challenge 2019 (Single coil track).☆10Dec 8, 2022Updated 3 years ago
- Minimize server usage by leveraging a decentralized peer-to-peer network for ultra-low-latency live streaming among users.☆13Feb 19, 2024Updated 2 years ago
- Multi-heap-sort for many small arrays, quicksort with 3 pivots for one big array, CUDA acceleration, CUDA memory compression.☆13Sep 29, 2024Updated 2 years ago
- Code for the ICML 2020 publication "Information Particle Filter Tree: An Online Algorithm for POMDPs with Belief-Based Rewards on Continu…☆14Jul 3, 2020Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A simple and trans-platform rag framework and tutorial☆231Jan 17, 2026Updated 9 months ago
- Optimize SGEMM step by step☆10Sep 4, 2024Updated 2 years ago
- 这是一个从头训练大语言模型的项目，包括预训练、微调和直接偏好优化，模型拥有1B参数，支持中英文。☆873Feb 18, 2025Updated last year
- Personal Decentralized Secret Storage☆15Updated this week
- ☆13Sep 21, 2022Updated 4 years ago
- ☆11Dec 16, 2023Updated 2 years ago
- rust implementation fo the DHT powering the HyperSwarm stack☆18Apr 1, 2022Updated 4 years ago