Implementation of Fast Weight Attention
☆35Sep 17, 2026Updated last month
Alternatives and similar repositories for fast-weight-attention
Users that are interested in fast-weight-attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Implementation of Recurrent Independent Mechanisms in Pytorch☆27Apr 6, 2026Updated 7 months ago
- Implementation of the fast weight product key memory from Sakana AI☆21Sep 17, 2026Updated last month
- Efficient implementation (and explorations) into polar coordinate positional embedding (PoPE) - from Gopalakrishnan et al. under Schmidhu…☆74Jun 21, 2026Updated 4 months ago
- Grouped Query Experts☆12Sep 21, 2026Updated last month
- Unofficial implementation of Hippoformer, Integrating Hippocampus-inspired Spatial Memory with Transformers☆57Aug 4, 2026Updated 3 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Causal Attention with Lookahead Keys☆28Sep 26, 2025Updated last year
- Implementation of 2-simplicial attention proposed by Clift et al. (2019) and the recent attempt to make practical in Fast and Simplex, Ro…☆49Sep 2, 2025Updated last year
- Explorations into the proposed Streaming Deep Reinforcement Learning, from University of Alberta☆32Nov 3, 2026Updated last week
- Explorations into the proposed SDFT, Self-Distillation Enables Continual Learning, from Shenfeld et al. of MIT☆33Feb 6, 2026Updated 9 months ago
- Implementation of various evolutionary algorithms, starting with evolutionary strategies☆53Updated this week
- Official repository for "SSA: Sparse Sparse Attention by Aligning Full and Sparse Attention Outputs in Feature Space"☆32May 7, 2026Updated 6 months ago
- An Affective Platform for AI in an Interdisciplinary Setting☆12Updated this week
- A method for evaluating the high-level coherence of machine-generated texts. Identifies high-level coherence issues in transformer-based …☆12Mar 18, 2023Updated 3 years ago
- Implementation of the dynamic chunking mechanism in H-net by Hwang et al. of Carnegie Mellon☆81Nov 5, 2026Updated last week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Implementation of RigidFormer, Learning Rigid Dynamics using Transformers☆32Aug 11, 2026Updated 3 months ago
- Some utility functions to help myself (and perhaps others) go faster with ML/AI work☆55Updated this week
- Efficient and unified implementations for TopK-based sparse attention☆41Jul 10, 2026Updated 4 months ago
- Exploration into Discrete Distribution Network, by Lei Yang out of Beijing☆38Aug 2, 2026Updated 3 months ago
- The Newton-Muon optimizer☆35Jun 5, 2026Updated 5 months ago
- Flash-Linear-Attention models beyond language☆21Aug 28, 2025Updated last year
- FlashRNN - Fast RNN Kernels with I/O Awareness☆190Updated this week
- Code for Fast-weight Product Key Memory (FwPKM)☆27Mar 18, 2026Updated 7 months ago
- Implementation and explorations into PopuLoRA, Co-Evolving LLM Populations for Reasoning Self-Play☆20Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- GPU Node ID (gni): hashes all GPU IDs in a node: `hash(GPU₀ + GPU₁ + ... + GPUₙ)`☆13Feb 20, 2026Updated 8 months ago
- LAGr: Label Aligned Graphs for Better Systematic Generalization in Semantic Parsing☆10Jun 1, 2022Updated 4 years ago
- Explorations into the proposed NeuralGrok from Zhou et al. of EPFL☆15Oct 18, 2025Updated last year
- NICE: Neurogenesis Inspired Contextual Encoding for Replay-free Class Incremental Learning☆29Jul 28, 2024Updated 2 years ago
- A technical exploration comparing standard deep RL (PPO) against biologically plausible learning rules on a custom Pong environment. Ever…☆29May 19, 2026Updated 5 months ago
- [ICLR 2026] Multi-Head Low-Rank Attention☆33Apr 16, 2026Updated 6 months ago
- Exploration into some new research surrounding value networks☆16Feb 10, 2026Updated 9 months ago
- ☆14Aug 7, 2026Updated 3 months ago
- Official repository Flash Local Linear Attention☆40May 28, 2026Updated 5 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆28Jul 14, 2024Updated 2 years ago
- Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT☆230Sep 23, 2026Updated last month
- ☆19Mar 29, 2026Updated 7 months ago
- Wuxing Search MCP is a powerful, unlimited search server built on top of SearXNG. It integrates seamlessly with Claude Code via the Model…☆13May 26, 2026Updated 5 months ago
- The Gaussian Histogram Loss (HL-Gauss) proposed by Imani et al. with a few convenient wrappers for regression, in Pytorch☆81Sep 2, 2026Updated 2 months ago
- Explorations into the recently proposed Taylor Series Linear Attention☆102Aug 27, 2026Updated 2 months ago
- Distributed Earthquake Early Warning (EEW) system built on low-cost ESP32-C3 IoT sensors with Zero-Trust security, multi-node epicenter t…☆24Nov 2, 2026Updated last week
Are these results useful?