several types of attention modules written in PyTorch for learning purposes
☆55Jan 2, 2026Updated 5 months ago
Alternatives and similar repositories for attention
Users that are interested in attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- (Unofficial) PyTorch implementation of grouped-query attention (GQA) from "GQA: Training Generalized Multi-Query Transformer Models from …☆194May 9, 2024Updated 2 years ago
- Re-implementation of Memory Networks (MemNN) paper of Facebook AI Research Lab.☆16May 6, 2020Updated 6 years ago
- The open source implementation of the cross attention mechanism from the paper: "JOINTLY TRAINING LARGE AUTOREGRESSIVE MULTIMODAL MODELS"☆37Mar 11, 2024Updated 2 years ago
- LLM - Detect AI Generated Text || Identify which essay was written by a large language model☆17Jan 17, 2024Updated 2 years ago
- Efficient implementation of Generative Stochastic Networks☆12Nov 28, 2013Updated 12 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- sigma-MoE layer☆21Jan 5, 2024Updated 2 years ago
- InternLM-7B微调, SFT/LoRA, instruction finetune☆13May 17, 2024Updated 2 years ago
- Spiking neural networks (SNNs) for speech classification☆12Mar 14, 2022Updated 4 years ago
- ☆11Aug 4, 2022Updated 3 years ago
- The tool facilitates debugging convergence issues and testing new algorithms and recipes for training LLMs using Nvidia libraries such as…☆20Sep 17, 2025Updated 8 months ago
- The open source implementation of the multi grouped query attention by the paper "GQA: Training Generalized Multi-Query Transformer Model…☆16Dec 11, 2023Updated 2 years ago
- In this data set, We have to predict the patients who are most likely to suffer from cervical cancer using Machine Learning algorithms fo…☆10Mar 31, 2019Updated 7 years ago
- An opinionated NLP research template☆10Aug 29, 2024Updated last year
- This Repo Contains Script To Fine Tune Open Source Models Using Unsloth by using UI with simple click and progress☆13Oct 3, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- The source code (Pytorch version) of paper "Multi-modality augmented Prototypical Network for Fault Diagnosis"☆11Aug 26, 2024Updated last year
- Code for data reduction and analysis of Galaxy Zoo 2☆14May 20, 2016Updated 10 years ago
- arXiv-Chat: An AI research assistant and Discord bot☆13Jul 16, 2023Updated 2 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆11Sep 4, 2025Updated 9 months ago
- Official PyTorch code for HILA☆28Nov 1, 2022Updated 3 years ago
- [AAAI'25] "Decomposed Spatio-Temporal Mamba for Long-Term Traffic Prediction"☆23May 30, 2025Updated last year
- Source Code for Online Collective Matrix Factorization Hashing. Reference: Di Wang, Quan Wang, Yaqiang An, Xinbo Gao, and Yumin Tian. 202…☆11Oct 20, 2020Updated 5 years ago
- TFSCL☆21Jul 25, 2024Updated last year
- ☆16Jun 14, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- React全家桶+AntD 共享单车后台管理系统开发☆14Aug 1, 2018Updated 7 years ago
- Progressive Attention Networks☆12Oct 25, 2016Updated 9 years ago
- Code for the paper "A Novel Interpretable Model via Algorithm Unrolling for Intelligent Fault Diagnosis of Machinery"☆13Dec 14, 2024Updated last year
- ☆19Sep 15, 2022Updated 3 years ago
- Semi-Supervised Change Detection with Feature-Prediction Alignment☆11Sep 14, 2023Updated 2 years ago
- Spatial Spectral Machine Learning☆14Oct 15, 2025Updated 7 months ago
- The open-source code of "CS-SHAP: Extending SHAP to Cyclic-Spectral Domain for Better Interpretability of Intelligent Fault Diagnosis".☆20Jul 12, 2025Updated 11 months ago
- This repository demonstrates how to use TensorFlow based SegFormer model in 🤗 transformers package.☆30Jul 25, 2022Updated 3 years ago
- A supervised contrastive learning method based on online complement strategy for long-tailed fine-grained fault diagnosis☆10Jan 5, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Tensorflow 2.0 Implementation of GCViT: Global Context Vision Transformer☆28Dec 24, 2023Updated 2 years ago
- Wantedlyのインターン情報や新卒採用についてのインフォメーションです☆11Apr 5, 2022Updated 4 years ago
- Create directory tree with attachments from Zotero☆11Jun 19, 2021Updated 4 years ago
- DeepKIN -- A deep learning toolkit for Kinyarwanda NLP.☆14Jun 4, 2025Updated last year
- Mixture of Experts from scratch☆14Apr 12, 2024Updated 2 years ago
- I personally studied VINS-MONO and commented in Korean.☆12Jan 3, 2024Updated 2 years ago
- Implementation for data driven prediction of battery cycle life before capacity degradation☆15Apr 16, 2021Updated 5 years ago