lizhenping / multi-head-self-attentionView external linksLinks
在sts数据集上用多头注意力机制上进行测试。 pytorch torchtext 代码简练，非常适合新手了解多头注意力机制的运作。不想transformer牵扯很多层 multi-head attention + one layer linear
☆18Aug 20, 2025Updated 5 months ago
Alternatives and similar repositories for multi-head-self-attention
Users that are interested in multi-head-self-attention are comparing it to the libraries listed below
Sorting:
- 天津财经大学2019年统计学院机器学习讨论班☆13Dec 9, 2019Updated 6 years ago
- 地图选点一键导出公交到达圈的小工具☆10Apr 4, 2022Updated 3 years ago
- 使用Few-Shot方法来做文本分类任务，基于THUCNews数据☆10Jun 4, 2020Updated 5 years ago
- A GAN architecture conditioned on Action Units (AU) annotations generating facial expressions in a continuous domain.☆11Nov 22, 2022Updated 3 years ago
- In this repository, I have used ARIMA,SARIMA,AutoArima,ANN,CNN and LSTMs for time series modelling and Anomaly detection has been done us…☆12Feb 8, 2021Updated 5 years ago
- knrm文本相似度☆10Aug 1, 2020Updated 5 years ago
- Alzheimer’s Disease (AD) is a neurological brain disorder marked by dementia and neurological dysfunction that affects memory, behavioral…☆16Aug 28, 2022Updated 3 years ago
- Classify image and text with ResNet and BERT models using Pytorch☆13Jul 7, 2020Updated 5 years ago
- ☆12Jun 18, 2020Updated 5 years ago
- Use numpy to build neuron network☆11May 17, 2022Updated 3 years ago
- Hierarchical Time Series Forecasting☆15Feb 8, 2023Updated 3 years ago
- Contrastive Distillation for Incremental Class Learning in Semantic Segmentation☆14Dec 13, 2021Updated 4 years ago
- Pytorch implementation of various traffic prediction modules(FC-LSTM, GRU, GCN, Diffusion Conv, Temporal Attention, etc.)☆12Jan 24, 2024Updated 2 years ago
- 中文领域的多模态Bert☆46Mar 24, 2020Updated 5 years ago
- 4th Year project aiming to implement PC, FCI and RFCI algorithms in python☆14Apr 29, 2019Updated 6 years ago
- This repository is the implementation of trajectory prediction's methods, such as LaneGCN, Vectornet, TNT...☆14May 26, 2023Updated 2 years ago
- RLMM is a reinforcement learning env for molecular modeling (currently only protein-ligand docking).☆11Nov 14, 2022Updated 3 years ago
- ☆15Oct 20, 2019Updated 6 years ago
- Deep reinforcement learning for protein complex modeling☆11May 28, 2022Updated 3 years ago
- ☆13Oct 3, 2017Updated 8 years ago
- 📖The Big-&-Extending-Repository-of-Transformers: Pretrained PyTorch models for Google's BERT, OpenAI GPT & GPT-2, Google/CMU Transformer…☆10Dec 4, 2020Updated 5 years ago
- Energy-based Graph Convolutional Networks for Scoring Protein Docking Models☆12Aug 31, 2021Updated 4 years ago
- Calculate the RMSD between two protein structures☆12Jun 29, 2022Updated 3 years ago
- ☆13May 26, 2022Updated 3 years ago
- 重构论文A Biterm Topic Model for Short Texts提供的源代码，编译成一个python 扩展模块，并用python 包装了一下，提供一个user-friendly python package☆11Apr 15, 2019Updated 6 years ago
- Implementation of the paper : Not all attention is needed - Gated Attention Network for Sequence Data (GA-Net) [https://arxiv.org/abs/191…☆13Aug 20, 2020Updated 5 years ago
- The official code for Paper “Multi-scale Temporal Fusion Transformer for Incomplete Vehicle Trajectory Prediction”☆19Jun 5, 2025Updated 8 months ago
- Google Research☆10Apr 20, 2022Updated 3 years ago
- The offical Pytorch code for "Continual Attentive Fusion for Incremental Learning in Semantic Segmentation"☆16Apr 8, 2022Updated 3 years ago
- 人工智能大作业：关于计算文本相似度的深度神经网络模型与算法研究分析(BERT、SentenceBERT、SimCSE)☆16Jul 11, 2022Updated 3 years ago
- ☆15Jan 16, 2024Updated 2 years ago
- Mojuan: Write your own AI application.☆16Jul 12, 2024Updated last year
- A Convolutional Neural Network approach for image-based anomaly detection in smart agriculture☆17Nov 21, 2021Updated 4 years ago
- Predicting Biomedical Interactions with Higher-Order Graph Convolutional Networks☆16Nov 9, 2021Updated 4 years ago
- ☆15Jan 30, 2026Updated 2 weeks ago
- The implementation and addtional material of AAAI2020 paper "Stable Learning via Sample Reweighting"☆19Mar 26, 2020Updated 5 years ago
- ☆17Sep 10, 2021Updated 4 years ago
- Relative and Absolute Location Embedding for Few-Shot Node Classification on Graph☆13Nov 13, 2022Updated 3 years ago
- Official implementation of paper "Stay on Track: Novel Loss Functions for Vehicle Trajectory Prediction"☆20Dec 5, 2024Updated last year