HazyResearch / mongooseLinks
A Learnable LSH Framework for Efficient NN Training
☆31Updated 3 years ago
Alternatives and similar repositories for mongoose
Users that are interested in mongoose are comparing it to the libraries listed below
Sorting:
- "Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices", official implementation☆29Updated 4 months ago
- Distributed ML Optimizer☆32Updated 3 years ago
- ☆14Updated 3 years ago
- ☆15Updated 3 years ago
- Blog post☆17Updated last year
- ☆28Updated 5 months ago
- Official repository for the paper "Going Beyond Linear Transformers with Recurrent Fast Weight Programmers" (NeurIPS 2021)☆49Updated 2 weeks ago
- RWKV model implementation☆38Updated last year
- Fast training of unitary deep network layers from low-rank updates☆28Updated 2 years ago
- A custom PyTorch layer that is capable of implementing extremely wide and sparse linear layers efficiently☆50Updated last year
- Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing☆50Updated 3 years ago
- ☆29Updated 2 years ago
- Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)☆62Updated 4 years ago
- Implementation of a Tensorflow XLA rematerialization pass☆15Updated 5 years ago
- ☆9Updated last year
- Learning Accurate Decision Trees with Bandit Feedback via Quantized Gradient Descent☆15Updated 2 years ago
- Source-to-Source Debuggable Derivatives in Pure Python☆15Updated last year
- JORA: JAX Tensor-Parallel LoRA Library (ACL 2024)☆34Updated last year
- Code for the paper: https://arxiv.org/pdf/2309.06979.pdf☆19Updated 10 months ago
- CUDA implementation of autoregressive linear attention, with all the latest research findings☆44Updated 2 years ago
- An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols☆16Updated 3 years ago
- Latest Weight Averaging (NeurIPS HITY 2022)☆30Updated 2 years ago
- Code release to reproduce ASHA experiments from "Random Search and Reproducibility for NAS."☆22Updated 5 years ago
- Some microbenchmarks and design docs before commencement☆12Updated 4 years ago
- ☆27Updated last year
- High dimensional black-box optimizer using Latent Action Monte Carlo Tree Search algorithm☆28Updated 2 years ago
- Make triton easier☆46Updated last year
- Experiment of using Tangent to autodiff triton☆79Updated last year
- A GPT, made only of MLPs, in Jax☆58Updated 4 years ago
- Distributed K-FAC preconditioner for PyTorch☆87Updated this week