idiap / hypermixingLinks
PyTorch implementation for HyperMixing, a linear-time token-mixing technique used in HyperMixer architecture
☆25Updated 2 years ago
Alternatives and similar repositories for hypermixing
Users that are interested in hypermixing are comparing it to the libraries listed below
Sorting:
- ☆26Updated last year
- Pytorch implementation of Simplified Structured State-Spaces for Sequence Modeling (S5)☆82Updated last year
- Implementation of the proposed minGRU in Pytorch☆318Updated last month
- Torch implementation of Soft-DTW, supports CUDA.☆46Updated 2 years ago
- Pytorch Reimplementation of DiffWave Vocoder: a high quality, fast, and small neural vocoder.☆91Updated 4 years ago
- [NeurIPS 2023 spotlight] Official implementation of HGRN in our NeurIPS 2023 paper - Hierarchically Gated Recurrent Neural Network for Se…☆66Updated last year
- Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch☆134Updated 3 months ago
- Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"☆56Updated 2 months ago
- Randomized Positional Encodings Boost Length Generalization of Transformers☆82Updated last year
- Pytorch implementation of conformer with with training script for end-to-end speech recognition on the LibriSpeech dataset.☆27Updated last year
- This is the official repository of the papers "Parameter-Efficient Transfer Learning of Audio Spectrogram Transformers" and "Efficient Fi…☆38Updated last year
- an implementation of FAdam (Fisher Adam) in PyTorch☆49Updated 6 months ago
- Inspired by "Neural Networks Fail to Learn Periodic Functions and How to Fix It"☆72Updated 6 months ago
- [SLT'24] The official implementation of SSAMBA: Self-Supervised Audio Representation Learning with Mamba State Space Model☆133Updated 2 months ago
- Implementation of GateLoop Transformer in Pytorch and Jax☆91Updated last year
- Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)☆127Updated 2 years ago
- Sequence Modeling with Structured State Spaces☆67Updated 3 years ago
- ☆108Updated last year
- Implementations of various linear RNN layers using pytorch and triton☆54Updated 2 years ago
- End-to-End Speech Processing Toolkit☆15Updated last year
- Griffin MQA + Hawk Linear RNN Hybrid☆88Updated last year
- A State-Space Model with Rational Transfer Function Representation.☆83Updated last year
- Pytorch implementation of the xLSTM model by Beck et al. (2024)☆181Updated last year
- ☆163Updated 2 years ago
- PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.☆87Updated last year
- Multi-Head-Attention RNN pytorch implement for keyword spotting☆19Updated 5 years ago
- PyTorch implementation of "Squeezeformer: An Efficient Transformer for Automatic Speech Recognition" (NeurIPS 2022)☆149Updated 3 years ago
- Implementation of Agent Attention in Pytorch☆93Updated last year
- Official PyTorch implementation of "EdVAE: Mitigating Codebook Collapse with Evidential Discrete Variational Autoencoders"☆13Updated last year
- ConMamba for Automatic Speech Recognition☆101Updated last year