本仓库定位为 AI论文复现 / 从零实现 Transformer。 代码遵循原论文的模块划分，包含位置编码、多头注意力、前馈网络、编码器‑解码器等全部组件，并附带详细的中文拆解文档与英文注释，方便学习与二次开发。
☆41May 3, 2025Updated last year
Alternatives and similar repositories for Transformer-from-Scratch
Users that are interested in Transformer-from-Scratch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 本项目从零开始构建并优化了一个千万参数级别的大规模预训练语言模型，涵盖预训练、有监督微调（SFT）和R1推理蒸馏三个阶段。项目采用自定义Transformer架构（ 包括RMSNorm、分组注意力、多Query机制、SwiGLU激活和RoPE位置编码），实现高效的长文本处理和…☆24Mar 10, 2025Updated last year
- BUAA Compiler Course Project 2023 by Toby Shi.☆13Aug 20, 2024Updated 2 years ago
- 龙芯杯2021个人赛决赛最终代码☆11Sep 1, 2021Updated 5 years ago
- Official Code for EMNLP 2023 paper: "Unveiling the Implicit Toxicity in Large Language Models""☆14Nov 30, 2023Updated 2 years ago
- An evaluation bentchmark for classical Chinese☆21Dec 13, 2023Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- micro-note markdown editor run local☆10Jul 13, 2023Updated 3 years ago
- ☆10Apr 5, 2023Updated 3 years ago
- 一款用python写的接口测试框架，可以对单接口 和多接口逻辑进行全方位的测试。框架分为三部分：1.执行前 2.执行中 3.执行后☆10May 24, 2017Updated 9 years ago
- 一个基于 bilibili 用户行为数据和深度学习的个性化视频推荐系统。☆29Mar 12, 2025Updated last year
- 🌟 The ultimate meta-collection of 200+ awesome LLM repositories☆39Oct 8, 2026Updated last week
- 一款优雅的 AI 网页分享卡片生成工具，利用 AI 帮助您将任何网页内容一键转换为精美的可视化分享卡片☆11Dec 4, 2024Updated last year
- A Winograd Minimal Filter Implementation in CUDA☆31Aug 25, 2021Updated 5 years ago
- Markdown转小红书卡片☆10Apr 10, 2025Updated last year
- Lite-MCP-Client是一个基于命令行的轻量级MCP客户端工具☆16Apr 1, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆10Feb 27, 2025Updated last year
- yolov11（yolov8）尝试了7种不同的部署方法，并对每种方法的优势进行了简单总结。不同的平台、不同的时耗或CPU占用需求，总有一种方法是适用的。针对想入门部署的也是一个很好的参考学习资料。☆51Jan 31, 2025Updated last year
- 微信小程序应用开发赛（后台）☆10Oct 24, 2020Updated 5 years ago
- Android MCP Server implementation☆15Jul 11, 2026Updated 3 months ago
- Fork from Goreplay. Change es package in order to link elasticsearch 6.x and more.☆10Jun 1, 2020Updated 6 years ago
- ☆10Jun 29, 2022Updated 4 years ago
- HttpRunner V1.x 中文使用文档☆11Dec 6, 2021Updated 4 years ago
- 小八嘎的地址☆18Jul 12, 2025Updated last year
- 仿vue-element-admin 项目 预览地址：☆10Aug 4, 2020Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval☆52Oct 31, 2024Updated last year
- 在终端中浏览v2ex☆17Apr 8, 2025Updated last year
- ☆12Dec 16, 2020Updated 5 years ago
- ☆15Sep 11, 2025Updated last year
- zenfeed Official lightweight WEB client☆19Feb 4, 2026Updated 8 months ago
- ☆12Aug 9, 2019Updated 7 years ago
- ☆12May 30, 2023Updated 3 years ago
- framework for apiTest☆13Jul 8, 2017Updated 9 years ago
- 全球设计系统：50种精选DESIGN.md + 20位设计大师方法论 + 120+风格知识库 | AI-agent-ready design style skill☆32Jul 4, 2026Updated 3 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Utilities for using gosnmp☆18Mar 4, 2026Updated 7 months ago
- 一个 oh-my-zsh 插件，让你通过 Kimi K2 (Moonshot) 运行 Claude Code☆16Jul 15, 2025Updated last year
- ☆17Updated this week
- 猫猫上云是什么体验？☆24Oct 6, 2023Updated 3 years ago
- ☆19Nov 14, 2025Updated 11 months ago
- 低代码，B站视频封面编辑生成工具☆19Dec 15, 2021Updated 4 years ago
- 一个提取小红书笔记信息写入到飞书多维表格的插件☆16May 4, 2025Updated last year