手撕transformer并完成一个简单的机器翻译。
☆23Feb 19, 2025Updated last year
Alternatives and similar repositories for transformer-from-scratch
Users that are interested in transformer-from-scratch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 此项目为西安交通大学信息工程资料共享计划☆46Jan 27, 2025Updated last year
- 基于langchain框架构建的rag小项目☆37May 22, 2024Updated 2 years ago
- 本项目从零开始构建并优化了一个千万参数级别的大规模预训练语言模型,涵盖预训练、有监督微调(SFT)和R1推理蒸馏三个阶段。项目采用自定义Transformer架构(包括RMSNorm、分组注意力、多Query机制、SwiGLU激活和RoPE位置编码),实现高效的长文本处理和…☆24Mar 10, 2025Updated last year
- [AAAI 2023] Pytorch Implementation for AAAI2023 paper: One-for-All: Proposal Masked Cross-Class Anomaly Detection☆15Oct 31, 2024Updated last year
- ☆14May 23, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- [AAAI 2026] Official code for the paper “CaTFormer: Causal Temporal Transformer with Dynamic Contextual Fusion for Driving Intention Pred…☆25Jan 16, 2026Updated 8 months ago
- 东华大学854考研科目真题答案,自己写的,可能会有错误,欢迎指正。☆12Dec 4, 2019Updated 6 years ago
- FastTrack4LLM 是一个为大模型学习者准备的大模型学习与实践框架,帮助他们轻松掌握大模型的核心原理与训练流程,让每个人都能真正理解大模型的内部机制。本项目不仅完整复现了 LLaMA、Qwen、DeepSeek 等主流开源大模型架构,还覆盖了大模型的全生命周期:To…☆31Nov 6, 2025Updated 11 months ago
- 国科大课程评价静态站:支持搜索筛选、评分汇总、批量填写导出并通过问卷提交(隐私友好、无后端)。☆45Jan 5, 2026Updated 9 months ago
- [原理解析] 大模型基本功(手撕Transformer模型、手撕PPO、GRPO、DPO训练器)☆33Jul 8, 2025Updated last year
- Author's PyTorch implementation of paper Reinforced Imitative Trajectory Planning for Urban Automated Driving☆17Aug 7, 2025Updated last year
- Implementation of TrajDiff: End-to-end Autonomous Driving without Perception Annotation☆18May 28, 2026Updated 4 months ago
- ☆23May 26, 2024Updated 2 years ago
- Python sample codes for robotics algorithms.☆19Dec 18, 2022Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- learning based uncertainty-aware 3D offroad navigation☆34Sep 1, 2023Updated 3 years ago
- 大模型面试八股文☆48May 31, 2025Updated last year
- 1.基于qwen3大模型或领域化qwen3大模型 2.neo4j知识图谱 3.向量检索 4.文本检索 5.问答实现☆25Feb 4, 2026Updated 8 months ago
- ☆31Feb 21, 2026Updated 7 months ago
- ☆25Apr 9, 2024Updated 2 years ago
- A Python implementation of the brain connectivity toolbox. **Not actively maintained.**☆38Feb 11, 2022Updated 4 years ago
- 大模型训练、推理、推荐系统相关☆30Nov 30, 2025Updated 10 months ago
- 一年过去了,你在洗脚食堂里花的钱都花在哪儿了?☆151Dec 27, 2024Updated last year
- 记录RAG学习过程中的相关知识和方法☆32Sep 23, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆35Jun 12, 2026Updated 3 months ago
- 面向个人投资者金融投资研究与辅助决策agent系统☆29Jul 9, 2026Updated 3 months ago
- langchain-study☆30Jul 21, 2026Updated 2 months ago
- 超简单使用监督微调SFT和强化学习RL去训练领域Agent☆35Oct 20, 2025Updated 11 months ago
- springboot+atomikos+mysql+mybatis+druid+分布式事务☆30Feb 2, 2018Updated 8 years ago
- Imagined speech recognition using EEG signals. KaraOne database, FEIS database.☆26Dec 24, 2025Updated 9 months ago
- This project aims to replicate mainstream open-source model architectures with limited computational resources, implementing mini models …☆294Aug 24, 2026Updated last month
- ☆61Sep 11, 2026Updated 3 weeks ago
- MMSI-Video-Bench: A Holistic Benchmark for Video-Based Spatial Intelligence☆62Mar 11, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [ICLR 2026] The official implementation of "Dichotomous Diffusion Policy Optimization"☆46May 2, 2026Updated 5 months ago
- Deep Contrastive One-Class Time Series Anomaly Detection☆38Jun 25, 2026Updated 3 months ago
- Arxiv 每日推送服务器☆59Mar 7, 2026Updated 7 months ago
- 🚀 A comprehensive LangGraph tutorial collection with hands-on Jupyter notebooks 一个全面的 LangGraph 教程项目,通过 Jupyter Notebook 形式展现,涵盖了 LangG…☆43Sep 2, 2025Updated last year
- Official implementation of Diffusion Time Estimation☆48Sep 18, 2024Updated 2 years ago
- 基于qwen3的医疗大模型研发全流程 0.分词训练 1.增量预训练 2.微调 3.强化 4.量化 5.蒸馏 6.评估 7.lora模型合并 8.服务 9.部署☆54Jan 3, 2026Updated 9 months ago
- awesome LLM papers! 🚀 🚀 🚀☆48Jul 3, 2025Updated last year