idiap / hypermixingLinks
PyTorch implementation for HyperMixing, a linear-time token-mixing technique used in HyperMixer architecture
☆25Updated 2 years ago
Alternatives and similar repositories for hypermixing
Users that are interested in hypermixing are comparing it to the libraries listed below
Sorting:
- an implementation of FAdam (Fisher Adam) in PyTorch☆49Updated 5 months ago
- This is the official repository of the papers "Parameter-Efficient Transfer Learning of Audio Spectrogram Transformers" and "Efficient Fi…☆38Updated last year
- ☆27Updated last year
- Implementation of the proposed minGRU in Pytorch☆315Updated 3 weeks ago
- End-to-End Speech Processing Toolkit☆15Updated 11 months ago
- [SLT'24] The official implementation of SSAMBA: Self-Supervised Audio Representation Learning with Mamba State Space Model☆133Updated last month
- Code for the paper: How Much Context Does My Attention-Based ASR System Need?☆11Updated 2 weeks ago
- ☆44Updated 7 years ago
- Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"☆56Updated 2 months ago
- Randomized Positional Encodings Boost Length Generalization of Transformers☆82Updated last year
- ☆44Updated 2 years ago
- Pytorch implementation of conformer with with training script for end-to-end speech recognition on the LibriSpeech dataset.☆26Updated last year
- A unified framework for Low-resource Audio Processing and Evaluation (SSL Pre-training and Downstream Fine-tuning)☆30Updated last year
- Pytorch Reimplementation of DiffWave Vocoder: a high quality, fast, and small neural vocoder.☆91Updated 4 years ago
- ☆104Updated last year
- Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch☆134Updated 2 months ago
- Conformer RNN-Transducer☆14Updated 3 years ago
- ☆26Updated last year
- Griffin MQA + Hawk Linear RNN Hybrid☆89Updated last year
- A minimal Pytorch Implementation of Stochastically Quantized Variational AutoEncoder (SQ-VAE) by Sony☆33Updated 2 years ago
- Implementations of various linear RNN layers using pytorch and triton☆54Updated 2 years ago
- [NeurIPS 2023 spotlight] Official implementation of HGRN in our NeurIPS 2023 paper - Hierarchically Gated Recurrent Neural Network for Se…☆66Updated last year
- Pytorch implementation of Simplified Structured State-Spaces for Sequence Modeling (S5)☆81Updated last year
- Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning☆48Updated 2 years ago
- Inspired by "Neural Networks Fail to Learn Periodic Functions and How to Fix It"☆71Updated 5 months ago
- Training RNNs as Fast as CNNs (https://arxiv.org/abs/1709.02755)☆38Updated 4 years ago
- LightHuBERT: Lightweight and Configurable Speech Representation Learning with Once-for-All Hidden-Unit BERT☆74Updated 3 years ago
- ConMamba for Automatic Speech Recognition☆101Updated last year
- Implementation of Google's USM speech model in Pytorch☆34Updated 2 months ago
- Code for the paper "FastAdaSP: An Efficient Multitask Inference Framework for Large Speech Language Models". @ EMNLP'24(Oral)☆12Updated last year