several types of attention modules written in PyTorch for learning purposes
☆55Jan 2, 2026Updated 8 months ago
Alternatives and similar repositories for attention
Users that are interested in attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- (Unofficial) PyTorch implementation of grouped-query attention (GQA) from "GQA: Training Generalized Multi-Query Transformer Models from …☆195May 9, 2024Updated 2 years ago
- Developer project for getting basic API integrations working in under 5 minutes☆11May 22, 2026Updated 3 months ago
- Spiking neural networks (SNNs) for speech classification☆12Mar 14, 2022Updated 4 years ago
- InternLM-7B微调, SFT/LoRA, instruction finetune☆13May 17, 2024Updated 2 years ago
- Lightweight multi-scale distillation attention network for image super-resolution☆11Sep 5, 2025Updated 11 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- collecting publicly available distillation datasets based on DepSeek-R1☆29Mar 12, 2025Updated last year
- Implementation of a Hierarchical Mamba as described in the paper: "Hierarchical State Space Models for Continuous Sequence-to-Sequence Mo…☆16Nov 11, 2024Updated last year
- The open source implementation of the multi grouped query attention by the paper "GQA: Training Generalized Multi-Query Transformer Model…☆17Dec 11, 2023Updated 2 years ago
- The source code (Pytorch version) of paper "Multi-modality augmented Prototypical Network for Fault Diagnosis"☆11Aug 26, 2024Updated 2 years ago
- In this data set, We have to predict the patients who are most likely to suffer from cervical cancer using Machine Learning algorithms fo…☆10Mar 31, 2019Updated 7 years ago
- Official PyTorch code for HILA☆28Nov 1, 2022Updated 3 years ago
- ☆22Nov 9, 2024Updated last year
- The open source implementation of the cross attention mechanism from the paper: "JOINTLY TRAINING LARGE AUTOREGRESSIVE MULTIMODAL MODELS"☆37Mar 11, 2024Updated 2 years ago
- Semi-Supervised Change Detection with Feature-Prediction Alignment☆11Sep 14, 2023Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Codes of "SPANet: Spatial Pyramid Attention Network for Enhanced Image Recognition"☆25Mar 31, 2020Updated 6 years ago
- GC-Net: Global Attention Module and Cascade Fusion Network for Steel Surface Defect Detection☆11Dec 2, 2024Updated last year
- A Multi-source Cross-speed Bearing Fault Diagnosis Method☆13Jan 7, 2025Updated last year
- This code repository is the source code of the paper "Deep Long-Range Spatiotemporal Dependency Synthetic Minority Oversampling Technique…☆15Nov 21, 2025Updated 9 months ago
- BitPack is a practical tool to efficiently save ultra-low precision/mixed-precision quantized models.☆58Feb 7, 2023Updated 3 years ago
- ☆16Jun 14, 2024Updated 2 years ago
- ☆12Apr 29, 2022Updated 4 years ago
- 在module level分析模型的性能☆12Jun 21, 2025Updated last year
- Code for the paper "A Novel Interpretable Model via Algorithm Unrolling for Intelligent Fault Diagnosis of Machinery"☆13Dec 14, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [PR2024] Official code for "MP-TFWA: Multi-schema prompting powered token-feature woven attention network for short text classification"☆13Jul 25, 2024Updated 2 years ago
- ☆19Sep 15, 2022Updated 3 years ago
- Coarse Grained Reconfigurable Arrays with Chisel3☆11Jul 1, 2024Updated 2 years ago
- Developed an Automatic Essay Grading tool in Python that utilizes TensorFlow to build a Four-Layer feed-forward neural network. Additiona…☆12Jul 12, 2017Updated 9 years ago
- ☆10Mar 28, 2022Updated 4 years ago
- This repository demonstrates how to use TensorFlow based SegFormer model in 🤗 transformers package.☆30Jul 25, 2022Updated 4 years ago
- Spatiotemporal Enhancement and Interlevel Fusion Network for Remote Sensing Images Change Detection, 2024☆50Feb 4, 2024Updated 2 years ago
- (ICML 2024) PyTorch implementation of "Self-Attention through Kernel-Eigen Pair Sparse Variational Gaussian Processes"☆16Oct 15, 2024Updated last year
- A supervised contrastive learning method based on online complement strategy for long-tailed fine-grained fault diagnosis☆10Jan 5, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Google Flan T5☆11Feb 5, 2023Updated 3 years ago
- Tensorflow 2.0 Implementation of GCViT: Global Context Vision Transformer☆28Dec 24, 2023Updated 2 years ago
- Code repository for the 2023 MICCAI Paper "TabAttention: Learning Attention Conditionally on Tabular Data"☆18Oct 30, 2023Updated 2 years ago
- sigma-MoE layer☆21Jan 5, 2024Updated 2 years ago
- ☆29Jul 9, 2024Updated 2 years ago
- Label Embedding Online Hashing for Cross-Modal Retrieval☆13Sep 22, 2025Updated 11 months ago
- 第六届龙芯杯混元形意太极门战队作品☆18May 15, 2022Updated 4 years ago