hyeon95y / SparseLinear

Related projects: ⓘ

• HazyResearch / structured-nets
  Structured matrices for compressing neural networks
  ☆65Updated 11 months ago
• ischlag / fast-weight-transformers
  Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.
  ☆97Updated 3 years ago
• davda54 / ada-hessian
  Easy-to-use AdaHessian optimizer (PyTorch)
  ☆77Updated 3 years ago
• RobertCsordas / transformer_generalization
  The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…
  ☆66Updated last year
• nec-research / tf-imle
  Tensorflow implementation and notebooks for Implicit Maximum Likelihood Estimation
  ☆68Updated 2 years ago
• harvardnlp / genbmm
  CUDA kernels for generalized matrix-multiplication in PyTorch
  ☆79Updated 2 years ago
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (affine group preconditioner, low-rank approximation preconditioner …
  ☆105Updated this week
• asappresearch / flop
  Pytorch library for factorized L0-based pruning.
  ☆42Updated 11 months ago
• gpauloski / kfac-pytorch
  Distributed K-FAC Preconditioner for PyTorch
  ☆75Updated last week
• ag1988 / dss
  Sequence Modeling with Structured State Spaces
  ☆60Updated 2 years ago
• tk-rusch / unicornn
  Official code for UnICORNN (ICML 2021)
  ☆27Updated 2 years ago
• choidami / sst
  ☆49Updated 3 years ago
• n2cholas / jax-resnet
  Implementations and checkpoints for ResNet, Wide ResNet, ResNeXt, ResNet-D, and ResNeSt in JAX (Flax).
  ☆103Updated 2 years ago
• thegregyang / NTK4A
  Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"
  ☆93Updated 4 years ago
• michaelsdr / sinkformers
  Transformers with doubly stochastic attention
  ☆40Updated 2 years ago
• edwardjhu / TP4
  Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)
  ☆57Updated 3 years ago
• IDSIA / recurrent-fwp
  Official repository for the paper "Going Beyond Linear Transformers with Recurrent Fast Weight Programmers" (NeurIPS 2021)
  ☆47Updated last year
• toshas / torch-discounted-cumsum
  Fast Discounted Cumulative Sums in PyTorch
  ☆95Updated 3 years ago
• aks2203 / deep-thinking
  A centralized place for deep thinking code and experiments
  ☆73Updated last year
• Ping-C / optimizer
  This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…
  ☆34Updated last year
• IST-DASLab / WoodFisher
  Code accompanying the NeurIPS 2020 paper: WoodFisher (Singh & Alistarh, 2020)
  ☆45Updated 3 years ago
• jfainberg / hashed_nets
  PyTorch implementation of HashedNets
  ☆35Updated last year
• g-benton / loss-surface-simplexes
  ☆96Updated 2 years ago
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆57Updated 10 months ago
• automl / zero-shot-automl-with-pretrained-models
  Official repository for the paper "Zero-Shot AutoML with Pretrained Models"
  ☆41Updated 8 months ago
• wouterkool / estimating-gradients-without-replacement
  Estimating Gradients for Discrete Random Variables by Sampling without Replacement
  ☆39Updated 4 years ago
• pkuzengqi / Skyformer
  Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)
  ☆58Updated 2 years ago
• shikaiqiu / compute-better-spent
  ☆42Updated 3 months ago
• akandykeller / TopographicVAE
  Official implementation of the paper "Topographic VAEs learn Equivariant Capsules"
  ☆77Updated 2 years ago
• mcbal / deep-implicit-attention
  Implementation of deep implicit attention in PyTorch
  ☆63Updated 3 years ago