Transformer的完整实现。详细构建Encoder、Decoder、Self-attention。以实际例子进行展示,有完整的输入、训练、预测过程。可用于学习理解self-attention和Transformer
☆135Apr 10, 2025Updated last year
Alternatives and similar repositories for Self-Attention
Users that are interested in Self-Attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 一个仿Linux的多级目录文件系统,系统由一个虚拟磁盘文件承载,以文件读写模拟磁盘读写。将虚拟磁盘划分为超级块区、inode位示图、block位示图、inode区、block区。空间管理采用位示图,盘块的分配和回收采用成组链接法。系统实现了用户管理、文件管理、目录管理等基本…☆12Mar 24, 2020Updated 6 years ago
- ✨✨ Official repo for "Comparative Analysis of Demonstration Selection Algorithms for LLM In-Context Learning"☆16Nov 8, 2024Updated last year
- the Pytorch implementation for our ICMR 2022 paper "TransPCC: Towards Deep Point Cloud Compression via Transformers"☆14Apr 15, 2022Updated 4 years ago
- 同济大学CS《计算机系统实验》实验一TongJi University CS computer system experiment assignment 1☆23May 19, 2023Updated 3 years ago
- A curated list of resources on Document Layout Analysis☆12Aug 7, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- code for paper "Discerning and Resolving Knowledge Conflicts through Adaptive Decoding with Contextual Information-Entropy Constraint"☆12Sep 29, 2024Updated 2 years ago
- Dynamic Traffic Prioritization in IoT networks using SDN (ONOS Controller and Mininet Topology)☆16Dec 9, 2017Updated 8 years ago
- ☆25May 8, 2025Updated last year
- 同济大学编译原理课程设计☆11Jun 12, 2021Updated 5 years ago
- 天津大学2017级软件工程计算机视觉课程大作业,参与者 赵为 周玮康 杨欣捷,基于改进Cascade-RCNN的垃圾目标检测系统☆13May 10, 2020Updated 6 years ago
- Stratum+ONOS demo @ ONF Connect 2019 & EuroP4 '19☆13Nov 16, 2022Updated 3 years ago
- ☆10Sep 30, 2019Updated 7 years ago
- ☆11Mar 15, 2023Updated 3 years ago
- ☆25Jan 22, 2021Updated 5 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆16Apr 27, 2026Updated 5 months ago
- 本项目从零开始构建并优化了一个千万参数级别的大规模预训练语言模型,涵盖预训练、有监督微调(SFT)和R1推理蒸馏三个阶段。项目采用自定义Transformer架构(包括RMSNorm、分组注意力、多Query机制、SwiGLU激活和RoPE位置编码),实现高效的长文本处理和…☆24Mar 10, 2025Updated last year
- BMInf demos.☆15Oct 14, 2021Updated 4 years ago
- Universal Asynchronous Receiver/Transmitter (UART) with FIFOs Soft IP☆15Feb 18, 2025Updated last year
- Parse SQL queries for network performance monitoring☆12Jul 20, 2018Updated 8 years ago
- Implementation and results for ICTIR2021 paper: Effective and Privacy-preserving Federated Online Learning to Rank☆11Jul 24, 2021Updated 5 years ago
- End to End training of Spatial Pyramid Networks☆13Apr 8, 2017Updated 9 years ago
- The official implementation for SETA (TIP 2024).☆12Feb 17, 2025Updated last year
- ☆14Dec 26, 2022Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆13Jan 7, 2025Updated last year
- ☆13Jul 13, 2022Updated 4 years ago
- An annotated transformer.☆13Jul 11, 2021Updated 5 years ago
- NetHCF: Enabling Line-rate and Adaptive Spoofed IP Traffic Filtering☆13Mar 17, 2022Updated 4 years ago
- Project of hardware course group in Tongji University☆16Dec 26, 2019Updated 6 years ago
- [AAAI 2023] Official PyTorch implementation for "Untargeted Attack against Federated Recommendation Systems via Poisonous Item Embeddings…☆28Jan 18, 2023Updated 3 years ago
- CUDA SGEMM optimization note☆16Oct 31, 2023Updated 2 years ago
- CCL2022汉语学习者文本纠错评测任务赛道二——CGED-8第一名解决方案☆54May 8, 2023Updated 3 years ago
- learn-P4-by-examples: P4 examples with Chinese documents.☆14Oct 25, 2019Updated 6 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆17Mar 22, 2026Updated 6 months ago
- MCP Client Implemented to FastAPI☆10Feb 26, 2025Updated last year
- OpenAI Router 轻量级、持久化、零配置的 OpenAI API 统一网关☆26Jul 19, 2026Updated 2 months ago
- ☆14Oct 8, 2024Updated 2 years ago
- Bloomfilter base on redis for java☆15Oct 13, 2020Updated 5 years ago
- 同济大学计算机科学与技术、信息安全专业作业链接仓库。含部分科目的习题、大作业仓库链接。期待各位的贡献与支持......☆271Sep 18, 2026Updated 3 weeks ago
- A Chinese Character BERT Trained with Multi-Level Masking☆13Sep 24, 2023Updated 3 years ago