本仓库定位为 AI论文复现 / 从零实现 Transformer。 代码遵循原论文的模块划分，包含位置编码、多头注意力、前馈网络、编码器‑解码器等全部组件，并附带详细的中文拆解文档与英文注释，方便学习与二次开发。
☆39May 3, 2025Updated last year
Alternatives and similar repositories for Transformer-from-Scratch
Users that are interested in Transformer-from-Scratch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- a simple neural network☆11Dec 20, 2018Updated 7 years ago
- 本项目从零开始构建并优化了一个千万参数级别的大规模预训练语言模型，涵盖预训练、有监督微调（SFT）和R1推理蒸馏三个阶段。项目采用自定义Transformer架构（包括RMSNorm、分组注意力、多Query机制、SwiGLU激活和RoPE位置编码），实现高效的长文本处理和…☆23Mar 10, 2025Updated last year
- This repo consists of my implementation of DocFormerV2☆12Mar 31, 2024Updated 2 years ago
- BUAA Compiler Course Project 2023 by Toby Shi.☆13Aug 20, 2024Updated last year
- 基于OpenPose卷积神经网络的人体姿态识别及预警系统☆35Jan 12, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- 操作系统实验 进程管理☆13May 24, 2017Updated 9 years ago
- 龙芯杯2021个人赛决赛最终代码☆11Sep 1, 2021Updated 4 years ago
- GitHub优秀项目(项目版)，长期更新☆13Sep 18, 2022Updated 3 years ago
- Android 14 Beta 1 framework/services source code, reverse engineered from a Pixel 7 Pro (upb1.230309.014)☆15Apr 13, 2023Updated 3 years ago
- 影速（GoComicMosaic的独立子项目）是一个用于测试影视采集接口速度和稳定性的工具。通过批量测试多个采集接口的响应时间、成功率和结果数量，进行综合打分排序。☆30Jun 17, 2025Updated last year
- 深澜Web认证, 校园网☆14Oct 17, 2020Updated 5 years ago
- Starting with Bi-Directional LSTMS☆19Mar 21, 2018Updated 8 years ago
- 2022秋季学期-北航计院-编译原理实验课设☆12Jun 25, 2023Updated 3 years ago
- 王者外挂工具☆22Oct 24, 2020Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- micro-note markdown editor run local☆10Jul 13, 2023Updated 3 years ago
- This is the official repository of the revised datasets FUNSD-r and CORD-r, introduced in EMNLP 2023 paper Reading Order Matters: Informa…☆17Mar 20, 2024Updated 2 years ago
- SIGIR 2024, Session-based recommendation, Co-occurrence patterns of ID, Fine-grained preferences of Modality, Disentanglement learning.☆23Sep 5, 2024Updated last year
- Multi-Attentional Deepfake Detection☆23Nov 15, 2024Updated last year
- ☆10Apr 5, 2023Updated 3 years ago
- some notes for opensource llm technical reorts☆19Mar 6, 2026Updated 5 months ago
- Data and Code for EMNLP 2023 paper "QTSumm: Query-Focused Summarization over Tabular Data"☆23Mar 29, 2024Updated 2 years ago
- 测试脚本和框架代码分离的轻量级接口自动化框架： 1、能够管理系统公共的数据，系统发生变化后方便切换 2、能够实现接口层级的复用，提高接口自动化脚本的可维护性 3、能够实现接口之间的关联，也就是需要结果提取器 4、能够操作数据库处理数据（预制数据、清理垃圾数据） 5、能够实现…☆11Mar 25, 2021Updated 5 years ago
- ☆21Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- AI empowers a general-purpose prompt assistant, systematically generating and selecting prompts on AI generation platforms such as Midjou…☆12Jan 8, 2026Updated 7 months ago
- 一个基于 bilibili 用户行为数据和深度学习的个性化视频推荐系统。☆27Mar 12, 2025Updated last year
- NSCSCC “龙芯杯” 2024 个人赛 LoongArch 赛道三等奖☆20Aug 17, 2024Updated last year
- Markdown转小红书卡片☆10Apr 10, 2025Updated last year
- 王者荣耀自动刷金币/经验脚本外挂☆26Jun 10, 2020Updated 6 years ago
- ☆21Dec 7, 2024Updated last year
- ☆10Feb 27, 2025Updated last year
- A comprehensive list of annotated training datasets classified by use case.☆39Jul 8, 2022Updated 4 years ago
- 微信小程序应用开发赛（后台）☆10Oct 24, 2020Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆12Oct 19, 2018Updated 7 years ago
- ☆59Mar 20, 2023Updated 3 years ago
- Android MCP Server implementation☆16Jul 11, 2026Updated last month
- Dataset and Code for ACL 2023 paper: "IM-TQA: A Chinese Table Question Answering Dataset with Implicit and Multi-type Table Structures". …☆27Aug 6, 2024Updated 2 years ago
- Fork from Goreplay. Change es package in order to link elasticsearch 6.x and more.☆10Jun 1, 2020Updated 6 years ago
- ☆24Updated this week
- 小八嘎的地址☆18Jul 12, 2025Updated last year