hyeon95y / SparseLinearLinks
A custom PyTorch layer that is capable of implementing extremely wide and sparse linear layers efficiently
☆51Updated last year
Alternatives and similar repositories for SparseLinear
Users that are interested in SparseLinear are comparing it to the libraries listed below
Sorting:
- Easy-to-use AdaHessian optimizer (PyTorch)☆79Updated 5 years ago
- Structured matrices for compressing neural networks☆67Updated 2 years ago
- Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.☆110Updated 4 years ago
- Tensorflow implementation and notebooks for Implicit Maximum Likelihood Estimation☆67Updated 3 years ago
- Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"☆106Updated 5 years ago
- Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)☆63Updated 4 years ago
- Distributed K-FAC preconditioner for PyTorch☆92Updated last week
- 🧀 Pytorch code for the Fromage optimiser.☆129Updated last year
- Official code for UnICORNN (ICML 2021)☆28Updated 4 years ago
- Differentiable Algorithms and Algorithmic Supervision.☆116Updated 2 years ago
- TensorLy-Torch: Deep Tensor Learning with TensorLy and PyTorch☆81Updated last year
- Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform☆43Updated 6 years ago
- Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch☆114Updated 2 years ago
- Implementation of deep implicit attention in PyTorch☆65Updated 4 years ago
- Study on the applicability of Direct Feedback Alignment to neural view synthesis, recommender systems, geometric learning, and natural la…☆89Updated 3 years ago
- Butterfly matrix multiplication in PyTorch☆177Updated 2 years ago
- ☆48Updated 2 years ago
- ☆125Updated last year
- PyTorch-SSO: Scalable Second-Order methods in PyTorch☆148Updated 2 years ago
- ICML 2020 Paper: Latent Variable Modelling with Hyperbolic Normalizing Flows☆54Updated 3 years ago
- ☆59Updated 5 years ago
- ☆68Updated 6 years ago
- Stochastic Automatic Differentiation library for PyTorch.☆208Updated last year
- Padé Activation Units: End-to-end Learning of Activation Functions in Deep Neural Network☆64Updated 4 years ago
- Bayesianize: A Bayesian neural network wrapper in pytorch☆90Updated last year
- Official repository for the paper "Zero-Shot AutoML with Pretrained Models"☆48Updated last year
- ☆100Updated 4 years ago
- Meta Optimal Transport☆105Updated 2 years ago
- This repository contains the results for the paper: "Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers"☆184Updated 4 years ago
- Implementations and checkpoints for ResNet, Wide ResNet, ResNeXt, ResNet-D, and ResNeSt in JAX (Flax).☆117Updated 3 years ago