hyeon95y / SparseLinearLinks
A custom PyTorch layer that is capable of implementing extremely wide and sparse linear layers efficiently
☆51Updated 2 years ago
Alternatives and similar repositories for SparseLinear
Users that are interested in SparseLinear are comparing it to the libraries listed below
Sorting:
- Structured matrices for compressing neural networks☆67Updated 2 years ago
- Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.☆111Updated 4 years ago
- Tensorflow implementation and notebooks for Implicit Maximum Likelihood Estimation☆67Updated 3 years ago
- Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"☆107Updated 5 years ago
- Easy-to-use AdaHessian optimizer (PyTorch)☆79Updated 5 years ago
- Stochastic Automatic Differentiation library for PyTorch.☆208Updated last year
- Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)☆62Updated 4 years ago
- Euclidean Wasserstein-2 optimal transportation☆46Updated 2 years ago
- Distributed K-FAC preconditioner for PyTorch☆94Updated last week
- Butterfly matrix multiplication in PyTorch☆178Updated 2 years ago
- Study on the applicability of Direct Feedback Alignment to neural view synthesis, recommender systems, geometric learning, and natural la…☆89Updated 3 years ago
- ☆100Updated 4 years ago
- ☆50Updated 5 years ago
- 🧀 Pytorch code for the Fromage optimiser.☆129Updated last year
- Differentiable Sorting Networks☆125Updated 2 years ago
- CUDA kernels for generalized matrix-multiplication in PyTorch☆85Updated 4 years ago
- Implicit MLE: Backpropagating Through Discrete Exponential Family Distributions☆259Updated 2 years ago
- Official repository for the paper "Going Beyond Linear Transformers with Recurrent Fast Weight Programmers" (NeurIPS 2021)☆51Updated 7 months ago
- Official code for UnICORNN (ICML 2021)☆28Updated 4 years ago
- Implementation of deep implicit attention in PyTorch☆65Updated 4 years ago
- Differentiable Algorithms and Algorithmic Supervision.☆116Updated 2 years ago
- Convolutional Neural Tangent Kernel☆112Updated 6 years ago
- ICML 2020 Paper: Latent Variable Modelling with Hyperbolic Normalizing Flows☆54Updated 3 years ago
- Pytorch implementation of VAEs for heterogeneous likelihoods.☆43Updated 3 years ago
- Repo to accompany paper "Implicit Self-Regularization in Deep Neural Networks..."☆47Updated 7 years ago
- ☆68Updated 6 years ago
- ☆59Updated 5 years ago
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆77Updated last year
- Codebase for Learning Invariances in Neural Networks☆96Updated 3 years ago
- Padé Activation Units: End-to-end Learning of Activation Functions in Deep Neural Network☆64Updated 4 years ago