several types of attention modules written in PyTorch for learning purposes
☆55Jan 2, 2026Updated 6 months ago
Alternatives and similar repositories for attention
Users that are interested in attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- (Unofficial) PyTorch implementation of grouped-query attention (GQA) from "GQA: Training Generalized Multi-Query Transformer Models from …☆194May 9, 2024Updated 2 years ago
- Developer project for getting basic API integrations working in under 5 minutes☆11May 22, 2026Updated 2 months ago
- Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format☆27Jul 12, 2023Updated 3 years ago
- ☆11Oct 11, 2023Updated 2 years ago
- Re-implementation of Memory Networks (MemNN) paper of Facebook AI Research Lab.☆16May 6, 2020Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This is a simple torch implementation of the high performance Multi-Query Attention☆16Aug 23, 2023Updated 2 years ago
- Implementation of Variance Reduction Techniques in Julia☆12Sep 6, 2016Updated 9 years ago
- Basic implementation of variational autoencoders in Torch☆10Apr 16, 2016Updated 10 years ago
- Experiments with encoding/compression integer sequences using different algorithms☆13Dec 1, 2013Updated 12 years ago
- InternLM-7B微调, SFT/LoRA, instruction finetune☆13May 17, 2024Updated 2 years ago
- ☆12Aug 4, 2022Updated 3 years ago
- ☆10Feb 19, 2019Updated 7 years ago
- Lightweight multi-scale distillation attention network for image super-resolution☆11Sep 5, 2025Updated 10 months ago
- Code for the article series on building a Python compiler and interpreter☆13Feb 13, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- collecting publicly available distillation datasets based on DepSeek-R1☆28Mar 12, 2025Updated last year
- Implementation of a Hierarchical Mamba as described in the paper: "Hierarchical State Space Models for Continuous Sequence-to-Sequence Mo…☆16Nov 11, 2024Updated last year
- The open source implementation of the multi grouped query attention by the paper "GQA: Training Generalized Multi-Query Transformer Model…☆17Dec 11, 2023Updated 2 years ago
- This Repo Contains Script To Fine Tune Open Source Models Using Unsloth by using UI with simple click and progress☆13Oct 3, 2024Updated last year
- Estimators for Information Theoretic Functionals using Influence Functions☆11Apr 17, 2016Updated 10 years ago
- In this data set, We have to predict the patients who are most likely to suffer from cervical cancer using Machine Learning algorithms fo…☆10Mar 31, 2019Updated 7 years ago
- Transformer-based autoregressive varitional autoencoder☆12Feb 10, 2020Updated 6 years ago
- Source Code for Online Collective Matrix Factorization Hashing. Reference: Di Wang, Quan Wang, Yaqiang An, Xinbo Gao, and Yumin Tian. 202…☆11Oct 20, 2020Updated 5 years ago
- Official PyTorch code for HILA☆28Nov 1, 2022Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A high-throughput and memory-efficient inference and serving engine for LLMs☆11Sep 4, 2025Updated 10 months ago
- Graph transport network (GTN), as proposed in "Scalable Optimal Transport in High Dimensions for Graph Distances, Embedding Alignment, an…☆15Apr 26, 2023Updated 3 years ago
- The open source implementation of the cross attention mechanism from the paper: "JOINTLY TRAINING LARGE AUTOREGRESSIVE MULTIMODAL MODELS"☆37Mar 11, 2024Updated 2 years ago
- Semi-Supervised Change Detection with Feature-Prediction Alignment☆11Sep 14, 2023Updated 2 years ago
- [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…☆39Mar 11, 2024Updated 2 years ago
- The official repo of Qwen2-Audio chat & pretrained large audio language model proposed by Alibaba Cloud.☆40Sep 8, 2024Updated last year
- Text of my bachelor thesis on Extracting Information from Database Modeling Tools☆15May 21, 2019Updated 7 years ago
- This code repository is the source code of the paper "Deep Long-Range Spatiotemporal Dependency Synthetic Minority Oversampling Technique…☆15Nov 21, 2025Updated 8 months ago
- BitPack is a practical tool to efficiently save ultra-low precision/mixed-precision quantized models.☆58Feb 7, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Human Activity Recognition with LSTM model and MLFlow Tracking☆11Jun 6, 2022Updated 4 years ago
- Code for "Towards Revealing the Mystery behind Chain of Thought: a Theoretical Perspective"☆21Jul 16, 2023Updated 3 years ago
- Progressive Attention Networks☆12Oct 25, 2016Updated 9 years ago
- Code for the paper "A Novel Interpretable Model via Algorithm Unrolling for Intelligent Fault Diagnosis of Machinery"☆13Dec 14, 2024Updated last year
- [PR2024] Official code for "MP-TFWA: Multi-schema prompting powered token-feature woven attention network for short text classification"☆13Jul 25, 2024Updated 2 years ago
- DeepKIN -- A deep learning toolkit for Kinyarwanda NLP.☆14Jun 4, 2025Updated last year
- ☆19Sep 15, 2022Updated 3 years ago