Implementation of Poly-attention, a higher-order self-attention proposed by Chakrabarti et al. of Columbia
☆55Aug 19, 2026Updated 2 months ago
Alternatives and similar repositories for poly-attention
Users that are interested in poly-attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Implementation of Strassen attention, from Kozachinskiy et al. of National Center of AI in Chile☆41Jul 8, 2025Updated last year
- Implementation of Recurrent Independent Mechanisms in Pytorch☆27Apr 6, 2026Updated 6 months ago
- Implementation and explorations into DiscoRL, Discovering state-of-the-art reinforcement learning algorithms, David Silver's last work at…☆22Jun 13, 2026Updated 4 months ago
- Implementation of RigidFormer, Learning Rigid Dynamics using Transformers☆32Aug 11, 2026Updated 2 months ago
- Unofficial implementation of Hippoformer, Integrating Hippocampus-inspired Spatial Memory with Transformers☆57Aug 4, 2026Updated 2 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Implementation of the Hierarchical Latent Action Model, proposed by Hanjung Kim et al. of Yonsei University☆17May 6, 2026Updated 5 months ago
- Implementation of Kalmanformer, modeling the Kalman gain with a transformer☆47Jun 2, 2026Updated 4 months ago
- Code for Fast-weight Product Key Memory (FwPKM)☆26Mar 18, 2026Updated 7 months ago
- Sharing how attention appears in my mind's eye, for students and those interested in understanding transformers☆60Updated this week
- Implementation of the fast weight product key memory from Sakana AI☆21Sep 17, 2026Updated last month
- Implementation of the recurrent looped transformer proposed by Yifan Zhang of Princeton☆61Sep 26, 2026Updated 3 weeks ago
- Implementation of the proposed CCBP (Continuous Continual BackProp) in Pytorch☆12Sep 3, 2026Updated last month
- Implementation of 2-simplicial attention proposed by Clift et al. (2019) and the recent attempt to make practical in Fast and Simplex, Ro…☆49Sep 2, 2025Updated last year
- Efficient implementation (and explorations) into polar coordinate positional embedding (PoPE) - from Gopalakrishnan et al. under Schmidhu…☆74Jun 21, 2026Updated 4 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Exploration into some new research surrounding value networks☆16Feb 10, 2026Updated 8 months ago
- Implementation of the model architecture for SRT-H☆30Oct 4, 2026Updated 2 weeks ago
- ☆20May 25, 2026Updated 4 months ago
- Transcript specific RNA splicing events lookup☆10Jun 22, 2026Updated 4 months ago
- rnalib: a python-based transcriptomics library☆14Jul 27, 2026Updated 2 months ago
- Just a repository that will house some MLPs and their variants, so to avoid having to reimplement them again and again for different proj…☆51Oct 15, 2026Updated last week
- Associative scan package for DRYing some code between repos☆19Jul 30, 2026Updated 2 months ago
- Implementation of ResFit, Residual Off-Policy RL for Finetuning Behavior Cloning Policies☆18Sep 29, 2025Updated last year
- Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch☆145Sep 3, 2026Updated last month
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Implementation and explorations into PopuLoRA, Co-Evolving LLM Populations for Reasoning Self-Play☆19Updated this week
- Causal Attention with Lookahead Keys☆28Sep 26, 2025Updated last year
- Implementation of HS-TasNet, "Real-time Low-latency Music Source Separation using Hybrid Spectrogram-TasNet"☆112Oct 13, 2026Updated last week
- Efficiently discovering algorithms via LLMs with evolutionary search and reinforcement learning.☆17Apr 22, 2025Updated last year
- Training framework for Large Behavioral Models☆28Sep 17, 2025Updated last year
- Implementation of UltraMem, improved Product Key Memory design, from Bytedance AI labs☆28Nov 4, 2025Updated 11 months ago
- FulQuant pipeline to identify and quantify transcript isoforms based on Nanopore long-read data☆10Jul 20, 2022Updated 4 years ago
- Do Vision Transformers Need All-to-All Attention? Global Communication Through Elastic Learned Cores☆22Oct 2, 2026Updated 2 weeks ago
- FlashRNN - Fast RNN Kernels with I/O Awareness☆190Sep 14, 2026Updated last month
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆12Oct 31, 2020Updated 5 years ago
- ITALIC: An ITALian Intent Classification Dataset☆14Nov 24, 2023Updated 2 years ago
- Implementation of the Paper Scene-Graph ViT☆10Dec 20, 2024Updated last year
- Implementation of a transformer for reinforcement learning using `x-transformers`☆72Sep 25, 2025Updated last year
- 🦞 The World's First Sensor-Agnostic Tactile Data Annotation Toolkit — Load any tactile sensor, annotate visually, export a unified schem…☆46Sep 7, 2026Updated last month
- A Ray Tracing-Inspired Approach to Neural Network Optimization☆17Jun 11, 2025Updated last year
- A technical exploration comparing standard deep RL (PPO) against biologically plausible learning rules on a custom Pong environment. Ever…☆29May 19, 2026Updated 5 months ago