HazyResearch / mongoose
A Learnable LSH Framework for Efficient NN Training
☆31Updated 3 years ago
Alternatives and similar repositories for mongoose:
Users that are interested in mongoose are comparing it to the libraries listed below
- Distributed ML Optimizer☆32Updated 3 years ago
- Some microbenchmarks and design docs before commencement☆12Updated 4 years ago
- ☆13Updated last month
- Fast training of unitary deep network layers from low-rank updates☆28Updated 2 years ago
- ☆14Updated 3 years ago
- RWKV model implementation☆37Updated last year
- "Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices", official implementation☆29Updated 3 months ago
- ☆29Updated 2 years ago
- ☆15Updated 3 years ago
- 👑 Pytorch code for the Nero optimiser.☆20Updated 2 years ago
- Learning Accurate Decision Trees with Bandit Feedback via Quantized Gradient Descent☆14Updated 2 years ago
- Factorized Neural Layers☆27Updated last year
- A framework for implementing equivariant DL☆10Updated 3 years ago
- ☆32Updated 7 months ago
- Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing☆49Updated 3 years ago
- CUDA implementation of autoregressive linear attention, with all the latest research findings☆44Updated last year
- Memory-efficient transformer. Work in progress.☆19Updated 2 years ago
- JORA: JAX Tensor-Parallel LoRA Library (ACL 2024)☆33Updated last year
- ☆27Updated 3 months ago
- Make triton easier☆47Updated 10 months ago
- Implementation of a Tensorflow XLA rematerialization pass☆15Updated 5 years ago
- Hyperparameter tuning via uncertainty modeling☆47Updated last year
- Parallel Associative Scan for Language Models☆18Updated last year
- Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)☆62Updated 3 years ago
- Sparsity support for PyTorch☆34Updated last month
- Implementation of Hyena Hierarchy in JAX☆10Updated 2 years ago
- Memory Optimizations for Deep Learning (ICML 2023)☆64Updated last year
- Source-to-Source Debuggable Derivatives in Pure Python☆15Updated last year
- The Energy Transformer block, in JAX☆57Updated last year
- Code for the paper: https://arxiv.org/pdf/2309.06979.pdf☆19Updated 9 months ago