Alternatives and similar repositories for SparseLinear:

Users that are interested in SparseLinear are comparing it to the libraries listed below

• HazyResearch / structured-nets
  Structured matrices for compressing neural networks
  ☆66Updated last year
• davda54 / ada-hessian
  Easy-to-use AdaHessian optimizer (PyTorch)
  ☆78Updated 4 years ago
• ischlag / fast-weight-transformers
  Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.
  ☆104Updated 3 years ago
• nec-research / tf-imle
  Tensorflow implementation and notebooks for Implicit Maximum Likelihood Estimation
  ☆67Updated 3 years ago
• RobertCsordas / transformer_generalization
  The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…
  ☆67Updated 2 years ago
• toshas / torch-discounted-cumsum
  Fast Discounted Cumulative Sums in PyTorch
  ☆95Updated 3 years ago
• shikaiqiu / compute-better-spent
  ☆52Updated 6 months ago
• choidami / sst
  ☆49Updated 4 years ago
• jfainberg / hashed_nets
  PyTorch implementation of HashedNets
  ☆36Updated 2 years ago
• ag1988 / dss
  Sequence Modeling with Structured State Spaces
  ☆63Updated 2 years ago
• tensorly / torch
  TensorLy-Torch: Deep Tensor Learning with TensorLy and PyTorch
  ☆78Updated 10 months ago
• michaelsdr / sinkformers
  Transformers with doubly stochastic attention
  ☆45Updated 2 years ago
• asappresearch / flop
  Pytorch library for factorized L0-based pruning.
  ☆45Updated last year
• minhtannguyen / SRSGD
  Code base for SRSGD.
  ☆28Updated 5 years ago
• lucidrains / mlp-gpt-jax
  A GPT, made only of MLPs, in Jax
  ☆57Updated 3 years ago
• edwardjhu / TP4
  Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)
  ☆62Updated 3 years ago
• ryoungj / mcbits
  [ICML'21 Oral] Improving Lossless Compression Rates via Monte Carlo Bits-Back Coding
  ☆14Updated 3 years ago
• adrianjav / heterogeneous_vaes
  Pytorch implementation of VAEs for heterogeneous likelihoods.
  ☆42Updated 2 years ago
• tk-rusch / unicornn
  Official code for UnICORNN (ICML 2021)
  ☆27Updated 3 years ago
• jxbz / madam
  👩 Pytorch and Jax code for the Madam optimiser.
  ☆51Updated 4 years ago
• IST-DASLab / WoodFisher
  Code accompanying the NeurIPS 2020 paper: WoodFisher (Singh & Alistarh, 2020)
  ☆49Updated 4 years ago
• ml-research / pau
  Padé Activation Units: End-to-end Learning of Activation Functions in Deep Neural Network
  ☆64Updated 4 years ago
• AlexanderMath / fasth
  Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.
  ☆75Updated 9 months ago
• IDSIA / recurrent-fwp
  Official repository for the paper "Going Beyond Linear Transformers with Recurrent Fast Weight Programmers" (NeurIPS 2021)
  ☆48Updated 2 years ago
• tk-rusch / LEM
  Official code for Long Expressive Memory (ICLR 2022, Spotlight)
  ☆69Updated 3 years ago
• cybertronai / pytorch-sso
  PyTorch-SSO: Scalable Second-Order methods in PyTorch
  ☆145Updated last year
• gibipara92 / learning-explanations-hard-to-vary
  Code to implement the AND-mask and geometric mean to do gradient based optimization, from the paper "Learning explanations that are hard …
  ☆39Updated 4 years ago
• JingzhaoZhang / why-clipping-accelerates
  A pytorch implementation for the LSTM experiments in the paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification f…
  ☆45Updated 5 years ago
• sjunhongshen / DASH
  ☆22Updated 2 years ago
• XuchanBao / linear-ae
  ☆13Updated 9 months ago