several types of attention modules written in PyTorch for learning purposes
☆53Jan 2, 2026Updated 2 months ago
Alternatives and similar repositories for attention
Users that are interested in attention are comparing it to the libraries listed below
Sorting:
- 🧠 A study guide to learn about Transformers☆12Jan 11, 2024Updated 2 years ago
- sigma-MoE layer☆21Jan 5, 2024Updated 2 years ago
- ☆16Nov 4, 2023Updated 2 years ago
- This is a simple torch implementation of the high performance Multi-Query Attention☆16Aug 23, 2023Updated 2 years ago
- ☆19Sep 15, 2022Updated 3 years ago
- Spatial Spectral Machine Learning☆14Oct 15, 2025Updated 4 months ago
- Re-implementation of Memory Networks (MemNN) paper of Facebook AI Research Lab.☆16May 6, 2020Updated 5 years ago
- ☆21Oct 12, 2022Updated 3 years ago
- ☆22Nov 9, 2024Updated last year
- Official PyTorch code for HILA☆28Nov 1, 2022Updated 3 years ago
- Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format☆27Jul 12, 2023Updated 2 years ago
- A PyTorch implementation of the Compact Multi-Head Self-Attention Mechanism from the paper: "Low Rank Factorization for Compact Multi-Hea…☆26Jan 13, 2020Updated 6 years ago
- Classification models 1D Zoo - Keras and TF.Keras☆28Jul 18, 2024Updated last year
- Tensorflow 2.0 Implementation of GCViT: Global Context Vision Transformer☆27Dec 24, 2023Updated 2 years ago
- Repository for discussion of OpenSAFELY codelists☆10Sep 10, 2024Updated last year
- ZYN: Zero-Shot Reward Models with Yes-No Questions☆35Aug 15, 2023Updated 2 years ago
- ☆14Jun 24, 2024Updated last year
- This repository demonstrates how to use TensorFlow based SegFormer model in 🤗 transformers package.☆30Jul 25, 2022Updated 3 years ago
- PyTorch implementation of Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation☆33Dec 29, 2021Updated 4 years ago
- Landing repository for the paper "Softpick: No Attention Sink, No Massive Activations with Rectified Softmax"☆88Sep 12, 2025Updated 5 months ago
- ☆12May 24, 2023Updated 2 years ago
- Continual Resilient (CoRe) Optimizer for PyTorch☆11Jun 10, 2024Updated last year
- The GitHub repository for the paper "Denoising Application of Magnetotelluric Low-Frequency Signal Processing"☆11Feb 22, 2023Updated 3 years ago
- Feature space plugin for QGIS. Visualize spectral feature space☆10Jul 1, 2023Updated 2 years ago
- [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…☆39Mar 11, 2024Updated last year
- Keras 3 Implementation of Video Swin Transformers for 3D Video Modeling☆32Oct 29, 2025Updated 4 months ago
- Mock of streamlit to allow unit tests☆10Aug 4, 2022Updated 3 years ago
- A modern, lightweight medication sig parser.☆12Jan 21, 2025Updated last year
- Source code for SWIFT, an efficient reward model.☆18Jan 13, 2026Updated last month
- Simple Javanese Macapat Generator using Markovify (Markov-Chain rules)☆10Feb 12, 2026Updated 3 weeks ago
- TOD-Flow: Modeling the Structure of Task-Oriented Dialogues☆13Feb 7, 2024Updated 2 years ago
- A neovim plugin to add notes or comments to any buffer☆13Sep 10, 2023Updated 2 years ago
- This is a modified version of the code for Hyperspectral image classification using CNN (Post-processing code is written in python).☆10Mar 3, 2018Updated 8 years ago
- A simple wrapper for python-bioformats to convert .vsi CellSense format to TIFF.☆12Apr 9, 2022Updated 3 years ago
- ☆13Jan 8, 2021Updated 5 years ago
- A library for hyperspectral image analysis using scikit-learn.☆10Apr 1, 2021Updated 4 years ago
- Ground truth for ntu viral sequences in CSV formats☆16Apr 2, 2024Updated last year
- [ICLR 2024] This is the official implementation for the paper: "Beyond imitation: Leveraging fine-grained quality signals for alignment"☆10May 5, 2024Updated last year
- A tool for generating synthetic data.☆18Dec 19, 2025Updated 2 months ago