HazyResearch / mongooseLinks
A Learnable LSH Framework for Efficient NN Training
☆32Updated 4 years ago
Alternatives and similar repositories for mongoose
Users that are interested in mongoose are comparing it to the libraries listed below
Sorting:
- "Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices", official implementation☆29Updated 7 months ago
- Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing☆50Updated 3 years ago
- An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols☆16Updated 4 years ago
- ☆15Updated 3 years ago
- 👑 Pytorch code for the Nero optimiser.☆20Updated 2 years ago
- Make triton easier☆47Updated last year
- ☆14Updated 2 years ago
- Learning Accurate Decision Trees with Bandit Feedback via Quantized Gradient Descent☆15Updated 3 years ago
- Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)☆63Updated 4 years ago
- NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference☆68Updated 9 months ago
- Official repository for the paper "Going Beyond Linear Transformers with Recurrent Fast Weight Programmers" (NeurIPS 2021)☆50Updated 3 months ago
- Distributed ML Optimizer☆32Updated 4 years ago
- Distributed K-FAC preconditioner for PyTorch☆90Updated last week
- Memory-efficient transformer. Work in progress.☆19Updated 3 years ago
- Meta-learning inductive biases in the form of useful conserved quantities.☆37Updated 2 years ago
- [NeurIPS 2022] DataMUX: Data Multiplexing for Neural Networks☆60Updated 2 years ago
- Pytorch library for factorized L0-based pruning.☆45Updated last year
- JAX implementation of "Fine-Tuning Language Models with Just Forward Passes"☆19Updated 2 years ago
- RWKV model implementation☆38Updated 2 years ago
- Usable implementation of Emerging Symbol Binding Network (ESBN), in Pytorch☆25Updated 4 years ago
- ☆29Updated 2 years ago
- Implementation of Hyena Hierarchy in JAX☆10Updated 2 years ago
- Code for Neural Execution Engines: Learning to Execute Subroutines☆17Updated 4 years ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆46Updated last year
- Code for the paper: https://arxiv.org/pdf/2309.06979.pdf☆20Updated last year
- ☆13Updated 3 months ago
- ☆27Updated 2 years ago
- PyTorch reimplementation of the paper "HyperMixer: An MLP-based Green AI Alternative to Transformers" [arXiv 2022].☆17Updated 3 years ago
- JAX/Flax implementation of the Hyena Hierarchy☆34Updated 2 years ago
- Ancestral Gumbel-Top-k Sampling☆25Updated 5 years ago