several types of attention modules written in PyTorch for learning purposes
☆55Jan 2, 2026Updated 8 months ago
Alternatives and similar repositories for attention
Users that are interested in attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- (Unofficial) PyTorch implementation of grouped-query attention (GQA) from "GQA: Training Generalized Multi-Query Transformer Models from …☆195May 9, 2024Updated 2 years ago
- 🧠 A study guide to learn about Transformers☆12Jan 11, 2024Updated 2 years ago
- Knock your images before you get stressed.☆11Aug 5, 2026Updated last month
- Developer project for getting basic API integrations working in under 5 minutes☆11May 22, 2026Updated 4 months ago
- Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format☆27Jul 12, 2023Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆11Oct 11, 2023Updated 2 years ago
- Spatial Spectral Machine Learning☆14Oct 15, 2025Updated 11 months ago
- ☆16Nov 4, 2023Updated 2 years ago
- Implementation of Variance Reduction Techniques in Julia☆12Sep 6, 2016Updated 10 years ago
- A Realtime App to visualize votes on who folks think will die in Episode 3 of Game of Thrones Season 8. Built using Vue.js, Hasura and C…☆14Dec 9, 2022Updated 3 years ago
- Spiking neural networks (SNNs) for speech classification☆12Mar 14, 2022Updated 4 years ago
- ☆12Aug 4, 2022Updated 4 years ago
- Implementation of a Hierarchical Mamba as described in the paper: "Hierarchical State Space Models for Continuous Sequence-to-Sequence Mo…☆16Nov 11, 2024Updated last year
- The open source implementation of the multi grouped query attention by the paper "GQA: Training Generalized Multi-Query Transformer Model…☆17Dec 11, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Wide Kernel Time-Frequency Fusion （WTFF）--Multi-Domain Time-Frequency Fusion Feature Contrastive Learning for Machinery Fault Diagnosis☆14Mar 21, 2025Updated last year
- This Repo Contains Script To Fine Tune Open Source Models Using Unsloth by using UI with simple click and progress☆12Oct 3, 2024Updated last year
- Estimators for Information Theoretic Functionals using Influence Functions☆11Apr 17, 2016Updated 10 years ago
- In this data set, We have to predict the patients who are most likely to suffer from cervical cancer using Machine Learning algorithms fo…☆10Mar 31, 2019Updated 7 years ago
- An opinionated NLP research template☆10Aug 29, 2024Updated 2 years ago
- Transformer-based autoregressive varitional autoencoder☆12Feb 10, 2020Updated 6 years ago
- Source Code for Online Collective Matrix Factorization Hashing. Reference: Di Wang, Quan Wang, Yaqiang An, Xinbo Gao, and Yumin Tian. 202…☆11Oct 20, 2020Updated 5 years ago
- Graph transport network (GTN), as proposed in "Scalable Optimal Transport in High Dimensions for Graph Distances, Embedding Alignment, an…☆15Apr 26, 2023Updated 3 years ago
- ☆17Jan 5, 2018Updated 8 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- The open source implementation of the cross attention mechanism from the paper: "JOINTLY TRAINING LARGE AUTOREGRESSIVE MULTIMODAL MODELS"☆37Mar 11, 2024Updated 2 years ago
- Equivalent Circuit Model for Lithium-Ion Batteries☆13Aug 15, 2023Updated 3 years ago
- A Multi-source Cross-speed Bearing Fault Diagnosis Method☆13Jan 7, 2025Updated last year
- This code repository is the source code of the paper "Deep Long-Range Spatiotemporal Dependency Synthetic Minority Oversampling Technique…☆15Nov 21, 2025Updated 10 months ago
- BitPack is a practical tool to efficiently save ultra-low precision/mixed-precision quantized models.☆58Feb 7, 2023Updated 3 years ago
- Human Activity Recognition with LSTM model and MLFlow Tracking☆11Jun 6, 2022Updated 4 years ago
- ☆16Jun 14, 2024Updated 2 years ago
- 在module level分析模型的性能☆12Jun 21, 2025Updated last year
- Code for the paper "A Novel Interpretable Model via Algorithm Unrolling for Intelligent Fault Diagnosis of Machinery"☆13Dec 14, 2024Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- A Handy Python wrapper for common NLP evaluation scripts like BLEU.☆14Feb 10, 2020Updated 6 years ago
- ☆19Sep 15, 2022Updated 4 years ago
- Developed an Automatic Essay Grading tool in Python that utilizes TensorFlow to build a Four-Layer feed-forward neural network. Additiona…☆12Jul 12, 2017Updated 9 years ago
- This repository demonstrates how to use TensorFlow based SegFormer model in 🤗 transformers package.☆30Jul 25, 2022Updated 4 years ago
- Template repo for Python projects, especially those focusing on machine learning and/or deep learning.☆15Jan 14, 2026Updated 8 months ago
- A supervised contrastive learning method based on online complement strategy for long-tailed fine-grained fault diagnosis☆10Jan 5, 2025Updated last year
- ☆21Oct 12, 2022Updated 3 years ago