idiap / hypermixingLinks
PyTorch implementation for HyperMixing, a linear-time token-mixing technique used in HyperMixer architecture
☆25Updated 2 years ago
Alternatives and similar repositories for hypermixing
Users that are interested in hypermixing are comparing it to the libraries listed below
Sorting:
- ☆26Updated last year
- Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"☆56Updated last month
- Randomized Positional Encodings Boost Length Generalization of Transformers☆83Updated last year
- Pytorch implementation of Simplified Structured State-Spaces for Sequence Modeling (S5)☆81Updated last year
- Implementations of various linear RNN layers using pytorch and triton☆54Updated 2 years ago
- [NeurIPS 2023 spotlight] Official implementation of HGRN in our NeurIPS 2023 paper - Hierarchically Gated Recurrent Neural Network for Se…☆66Updated last year
- This is the official repository of the papers "Parameter-Efficient Transfer Learning of Audio Spectrogram Transformers" and "Efficient Fi…☆38Updated last year
- Implementation of the proposed minGRU in Pytorch☆310Updated 8 months ago
- Implementation of GateLoop Transformer in Pytorch and Jax☆91Updated last year
- Griffin MQA + Hawk Linear RNN Hybrid☆89Updated last year
- A Pytorch implementation of "Rare Tokens Degenerate All Tokens: Improving Neural Text Generation via Adaptive Gradient Gating for Rare To…☆10Updated 3 years ago
- Sequence Modeling with Structured State Spaces☆66Updated 3 years ago
- A State-Space Model with Rational Transfer Function Representation.☆83Updated last year
- Pytorch implementation of conformer with with training script for end-to-end speech recognition on the LibriSpeech dataset.☆26Updated last year
- Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch☆134Updated last month
- Pytorch Reimplementation of DiffWave Vocoder: a high quality, fast, and small neural vocoder.☆91Updated 4 years ago
- PyTorch implementation of "Squeezeformer: An Efficient Transformer for Automatic Speech Recognition" (NeurIPS 2022)☆147Updated 3 years ago
- [SLT'24] The official implementation of SSAMBA: Self-Supervised Audio Representation Learning with Mamba State Space Model☆131Updated 3 weeks ago
- Inspired by "Neural Networks Fail to Learn Periodic Functions and How to Fix It"☆69Updated 4 months ago
- This repository contains the SpeechBrain Benchmarks☆131Updated 4 months ago
- Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)☆127Updated 2 years ago
- End-to-End Speech Processing Toolkit☆15Updated 10 months ago
- Ke-Omni-R is an advanced audio reasoning model and achieved SOTA on MMAU☆55Updated 5 months ago
- SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition☆90Updated 5 years ago
- The accompanying code for "Simplifying and Understanding State Space Models with Diagonal Linear RNNs" (Ankit Gupta, Harsh Mehta, Jonatha…☆23Updated 2 years ago
- PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.☆86Updated last year
- ☆164Updated 2 years ago
- ☆14Updated 2 years ago
- [ICLR 2023] Official implementation of Transnormer in our ICLR 2023 paper - Toeplitz Neural Network for Sequence Modeling☆80Updated last year
- Code for "Theoretical Foundations of Deep Selective State-Space Models" (NeurIPS 2024)☆15Updated 10 months ago