several types of attention modules written in PyTorch for learning purposes
☆55Jan 2, 2026Updated 10 months ago
Alternatives and similar repositories for attention
Users that are interested in attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- (Unofficial) PyTorch implementation of grouped-query attention (GQA) from "GQA: Training Generalized Multi-Query Transformer Models from …☆196May 9, 2024Updated 2 years ago
- Code and datasets for CVPR 2025 accepted paper Harnessing Frozen Unimodal Encoders for Flexible Multimodal Alignment☆13Jun 11, 2025Updated last year
- Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format☆27Jul 12, 2023Updated 3 years ago
- Re-implementation of Memory Networks (MemNN) paper of Facebook AI Research Lab.☆16May 6, 2020Updated 6 years ago
- Efficient implementation of Generative Stochastic Networks☆12Nov 28, 2013Updated 12 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆15Jun 21, 2023Updated 3 years ago
- Implementation of Variance Reduction Techniques in Julia☆12Sep 6, 2016Updated 10 years ago
- [COLM'24] HDT: Hierarchical Document Transformer☆12Jul 13, 2024Updated 2 years ago
- Implementation of a Hierarchical Mamba as described in the paper: "Hierarchical State Space Models for Continuous Sequence-to-Sequence Mo…☆16Nov 11, 2024Updated last year
- [GMP2024 & CAGD] PointeNet: A Lightweight Framework for Effective and Efficient Point Cloud Analysis☆13Jun 27, 2024Updated 2 years ago
- Implementation of Infini-Transformer in Pytorch☆112Jan 4, 2025Updated last year
- LLM - Detect AI Generated Text || Identify which essay was written by a large language model☆17Jan 17, 2024Updated 2 years ago
- InternLM-7B微调, SFT/LoRA, instruction finetune☆13May 17, 2024Updated 2 years ago
- This repository is the official PyTorch implementation of "CLEEGN: A Convolutional Neural Network for Plug-and-Play Automatic EEG Reconst…☆11Mar 8, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Vision Transformer and Convolutional Neural Network Cycle-Consistent Generative Adversarial☆12Dec 11, 2023Updated 2 years ago
- An opinionated NLP research template☆10Aug 29, 2024Updated 2 years ago
- ☆10Feb 19, 2019Updated 7 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆11Sep 4, 2025Updated last year
- Spatial Spectral Machine Learning☆14Oct 15, 2025Updated last year
- The open source implementation of the multi grouped query attention by the paper "GQA: Training Generalized Multi-Query Transformer Model…☆17Dec 11, 2023Updated 2 years ago
- When real time Yoga Position classification meets GNN☆11Sep 17, 2023Updated 3 years ago
- SHUOSC RISC-V implementation☆11May 12, 2024Updated 2 years ago
- [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…☆39Mar 11, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Official PyTorch code for HILA☆28Nov 1, 2022Updated 4 years ago
- Technical Analysis Library using Pandas (Modin for speedup) (Python)☆11Jun 24, 2019Updated 7 years ago
- BitPack is a practical tool to efficiently save ultra-low precision/mixed-precision quantized models.☆58Feb 7, 2023Updated 3 years ago
- ☆16Jul 11, 2023Updated 3 years ago
- ☆10Dec 19, 2022Updated 3 years ago
- ☆12Apr 29, 2022Updated 4 years ago
- ☆12Aug 4, 2022Updated 4 years ago
- template match base gray model (Normalized cross correlation)☆23Dec 5, 2025Updated 10 months ago
- ☆19Sep 15, 2022Updated 4 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Wavelet Neural Network☆13Dec 3, 2018Updated 7 years ago
- Google Flan T5☆11Feb 5, 2023Updated 3 years ago
- sigma-MoE layer☆21Jan 5, 2024Updated 2 years ago
- 在module level分析模型的性能☆12Jun 21, 2025Updated last year
- React全家桶+AntD 共享单车后台管理系统开发☆14Aug 1, 2018Updated 8 years ago
- Dataset for active learning for concept prerequisite learning☆24May 21, 2018Updated 8 years ago
- Track Deadlines of AI/ML Conferences☆16Sep 28, 2026Updated last month