Transformer的完整实现。详细构建Encoder、Decoder、Self-attention。以实际例子进行展示，有完整的输入、训练、预测过程。可用于学习理解self-attention和Transformer
☆133Apr 10, 2025Updated last year
Alternatives and similar repositories for Self-Attention
Users that are interested in Self-Attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆10Apr 15, 2023Updated 3 years ago
- ✨✨ Official repo for "Comparative Analysis of Demonstration Selection Algorithms for LLM In-Context Learning"☆16Nov 8, 2024Updated last year
- the Pytorch implementation for our ICMR 2022 paper "TransPCC: Towards Deep Point Cloud Compression via Transformers"☆14Apr 15, 2022Updated 4 years ago
- Code for ijcai-24 paper "Federated Adaptation for Foundation Model-based Recommendations"☆11Apr 18, 2025Updated last year
- Review for Course 100396,Tongji Uni.☆39Mar 13, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Official Code for FedRule: Federated Rule Recommendation System with Graph Neural Networks☆14Sep 12, 2023Updated 2 years ago
- HFMF: Hierarchical Fusion Meets Multi-Stream Models for Deepfake Detection☆13Jan 6, 2025Updated last year
- State of Charge estimation for lithium-ion batteries using deep learning approach☆10May 12, 2024Updated 2 years ago
- Dynamic Traffic Prioritization in IoT networks using SDN (ONOS Controller and Mininet Topology)☆16Dec 9, 2017Updated 8 years ago
- The objective of this project is to showcase how the performance of a multi-sensor system can be improved by reducing uncertainty, improv…☆12Jun 20, 2022Updated 4 years ago
- Implementation of IMvGCN in our paper: Interpretable Graph Convolutional Network for Multi-view Semi-supervised Learning, IEEE TMM.☆11Mar 25, 2024Updated 2 years ago
- ☆12Feb 7, 2018Updated 8 years ago
- 同济大学编译原理课程设计☆11Jun 12, 2021Updated 5 years ago
- This project is for paper " PFFN: A Parallel Feature Fusion Network for Remaining Useful Life Early Prediction of Lithium-ion Battery …☆10Apr 17, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Repository of Near-field Acoustic Holography analysis with Convolutional Neural Networks☆12Dec 16, 2020Updated 5 years ago
- A Novel Patch-Based Transformer for Accurate Remaining Useful Life Prediction of Lithium-Ion Batteries☆43Mar 17, 2026Updated 5 months ago
- A medical knowledge graph related website, utilizing technologies and frameworks such as Django, Bootstrap, Echarts, with MySQL and neo4j…☆12Jun 9, 2024Updated 2 years ago
- ☆14Aug 22, 2024Updated 2 years ago
- ☆18Feb 12, 2025Updated last year
- ☆15Aug 21, 2023Updated 3 years ago
- ☆25Jan 22, 2021Updated 5 years ago
- Implement model predictive control on a physics-based battery model for minimizing charging time while maximizing lifetime.☆11Apr 4, 2023Updated 3 years ago
- unofficial implementation of https://arxiv.org/pdf/2301.08871v1.pdf on pytorch☆15Apr 20, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆17Apr 27, 2026Updated 4 months ago
- 本项目从零开始构建并优化了一个千万参数级别的大规模预训练语言模型，涵盖预训练、有监督微调（SFT）和R1推理蒸馏三个阶段。项目采用自定义Transformer架构（包括RMSNorm、分组注意力、多Query机制、SwiGLU激活和RoPE位置编码），实现高效的长文本处理和…☆23Mar 10, 2025Updated last year
- Estimate depth from surface normal.☆12Aug 14, 2020Updated 6 years ago
- 记录自己学习TensorFlow的笔记和代码☆12Jul 1, 2018Updated 8 years ago
- Battery temperature prediction☆14Mar 14, 2024Updated 2 years ago
- ☆11Jan 14, 2021Updated 5 years ago
- A Tensorflow Implementation of Dual-Stage Attention-Based Recurrent Neural Network for Time Series Prediction☆14Mar 9, 2020Updated 6 years ago
- ☆13Jan 7, 2025Updated last year
- The source code for the paper "LightFR: Lightweight Federated Recommendation with Privacy-preserving Matrix Factorization".☆19Dec 3, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [AAAI 2025 (Oral)] SAIL: Sample-Centric In-Context Learning for Document Information Extraction☆19Dec 24, 2024Updated last year
- The 💩DaBian programming language. 💩"答辩"编程语言, 编程不是💩"答辩"的我不学!☆10Sep 28, 2023Updated 2 years ago
- [AAAI 2023] Official PyTorch implementation for "Untargeted Attack against Federated Recommendation Systems via Poisonous Item Embeddings…☆27Jan 18, 2023Updated 3 years ago
- CUDA SGEMM optimization note☆15Oct 31, 2023Updated 2 years ago
- MCP Client Implemented to FastAPI☆10Feb 26, 2025Updated last year
- OpenAI Router 轻量级、持久化、零配置的 OpenAI API 统一网关☆25Jul 19, 2026Updated last month
- ☆14Oct 8, 2024Updated last year