lucidrains / simplicial-attentionView external linksLinks
Implementation of 2-simplicial attention proposed by Clift et al. (2019) and the recent attempt to make practical in Fast and Simplex, Roy et al. (2025)
☆46Sep 2, 2025Updated 5 months ago
Alternatives and similar repositories for simplicial-attention
Users that are interested in simplicial-attention are comparing it to the libraries listed below
Sorting:
- Official Project Page for HLA: Higher-order Linear Attention (https://arxiv.org/abs/2510.27258)☆44Jan 6, 2026Updated last month
- coded with and corrected by Google Anti-Gravity☆13Nov 23, 2025Updated 2 months ago
- [ICLR26] AI-based scaling law discovery☆25Jan 30, 2026Updated 2 weeks ago
- Implementation of an Attention layer where each head can attend to more than just one token, using coordinate descent to pick topk☆47Jul 16, 2023Updated 2 years ago
- Implementation of the proposed MaskBit from Bytedance AI☆83Nov 12, 2024Updated last year
- ☆42Jan 24, 2026Updated 3 weeks ago
- ☆13Sep 13, 2023Updated 2 years ago
- Hierarchical Dirichlet Process Generalized Linear Models☆12Apr 19, 2025Updated 9 months ago
- Data analysis library for Python using "Dirichlet Process"-based models.☆19Mar 1, 2024Updated last year
- Conformer block with Rotary Position Embedding, modified from lucidrains' implement☆16Sep 13, 2024Updated last year
- Wave: Python Domain-Specific Language for High Performance Machine Learning☆44Updated this week
- ☆32Jul 2, 2025Updated 7 months ago
- Custom triton kernels for training Karpathy's nanoGPT.☆19Oct 21, 2024Updated last year
- Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch☆135Oct 15, 2025Updated 4 months ago
- FlashRNN - Fast RNN Kernels with I/O Awareness☆174Oct 20, 2025Updated 3 months ago
- My submission for the GPUMODE/AMD fp8 mm challenge☆29Jun 4, 2025Updated 8 months ago
- Implementation of a holodeck, written in Pytorch☆18Nov 1, 2023Updated 2 years ago
- Real-time end-to-end singing voice convertion☆23Nov 3, 2024Updated last year
- Implementation of ReWiND, "Language-Guided Rewards Teach Robot Policies without New Demonstrations", from USC / Amazon Robotics☆35Aug 15, 2025Updated 6 months ago
- Code implementation for "Feedforward 3D Editing via Text-Steerable Image-to-3D"☆44Dec 23, 2025Updated last month
- research impl of Native Sparse Attention (2502.11089)☆63Feb 19, 2025Updated 11 months ago
- Efficient implementation (and explorations) into polar coordinate positional embedding (PoPE) - from Gopalakrishnan et al. under Schmidhu…☆51Jan 27, 2026Updated 3 weeks ago
- Unofficial PyTorch implementation of "Autoregressive Speech Synthesis without Vector Quantization (MELLE)"☆41Jun 28, 2025Updated 7 months ago
- A Transformer made of Rotation-equivariant Attention using Vector Neurons☆101Aug 1, 2023Updated 2 years ago
- ☆27May 3, 2024Updated last year
- ☆24Jun 4, 2024Updated last year
- Explorations into the recently proposed Taylor Series Linear Attention☆100Aug 18, 2024Updated last year
- ☆65Apr 26, 2025Updated 9 months ago
- A simple, hackable text-to-speech system in PyTorch and MLX☆186Aug 3, 2025Updated 6 months ago
- Interpretability methods to analyze the behavior and individual predictions of modern neural networks in R.☆31Mar 30, 2025Updated 10 months ago
- Software Engineering Back End Microservices Project☆15Nov 20, 2024Updated last year
- User-friendly implementation of the Mixture-of-Sparse-Attention (MoSA). MoSA selects distinct tokens for each head with expert choice rou…☆28May 3, 2025Updated 9 months ago
- Aggregating embeddings over time☆32Jan 19, 2023Updated 3 years ago
- Syllable Segmentation and Cross-Lingual Generalization in a Visually Grounded, Self-Supervised Speech Model☆34Aug 27, 2023Updated 2 years ago
- An High-resolution implementation of HiFi-GAN Vocoder for Voice Conversion.☆32Apr 10, 2023Updated 2 years ago
- ☆33Jan 6, 2025Updated last year
- ☆34Sep 10, 2024Updated last year
- Mask-Enhanced Autoregressive Prediction: Pay Less Attention to Learn More☆34May 17, 2025Updated 9 months ago
- Flash Attention Triton kernel with support for second-order derivatives☆144Feb 4, 2026Updated last week