Alternatives and similar repositories for self-expanding-neural-networks

Users that are interested in self-expanding-neural-networks are comparing it to the libraries listed below

• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆127Updated 2 years ago
• lucidrains / complex-valued-transformer
  Implementation of the transformer proposed in "Building Blocks for a Complex-Valued Transformer Architecture"
  ☆86Updated 2 years ago
• TariqAHassan / S4Torch
  PyTorch implementation of Structured State Space for Sequence Modeling (S4), based on Annotated S4.
  ☆87Updated last year
• jacobfa / fft
  ☆129Updated 4 months ago
• AhmedImtiazPrio / grok-adversarial
  Deep Networks Grok All the Time and Here is Why
  ☆38Updated last year
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆56Updated last year
• hyperevolnet / Terminator
  The official repository for HyperZ⋅Z⋅W Operator Connects Slow-Fast Networks for Full Context Interaction.
  ☆41Updated 8 months ago
• NVlabs / ConvSSM
  ☆69Updated last year
• locuslab / torchdeq
  Modern Fixed Point Systems using Pytorch
  ☆125Updated 2 years ago
• KindXiaoming / Omnigrok
  Omnigrok: Grokking Beyond Algorithmic Data
  ☆62Updated 2 years ago
• smonsays / hypernetwork-attention
  Official code for the paper "Attention as a Hypernetwork"
  ☆46Updated last year
• GistNoesis / FusedFourierKAN
  C++ and Cuda ops for fused FourierKAN
  ☆82Updated last year
• AvivNavon / DWSNets
  Official implementation for Equivariant Architectures for Learning in Deep Weight Spaces [ICML 2023]
  ☆90Updated 2 years ago
• test-time-training / ttt-lm-kernels
  Inference Speed Benchmark for Learning to (Learn at Test Time): RNNs with Expressive Hidden States
  ☆76Updated last year
• quiqi / relu_kan
  ☆97Updated last year
• Adamdad / rational_kat_cu
  ☆77Updated 10 months ago
• ruke1ire / RTF
  A State-Space Model with Rational Transfer Function Representation.
  ☆83Updated last year
• apple / ml-pararnn
  ☆156Updated last month
• shikaiqiu / compute-better-spent
  ☆62Updated last year
• AllanYangZhou / universal_neural_functional
  ☆54Updated last year
• JunLi-Galios / Optimization-on-Stiefel-Manifold-via-Cayley-Transform
  Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform
  ☆43Updated 6 years ago
• machine-discovery / deer
  Parallelizing non-linear sequential models over the sequence length
  ☆56Updated 6 months ago
• lxxue / prefix_sum
  A PyTorch wrapper of parallel exclusive scan in CUDA
  ☆12Updated 2 years ago
• orobix / fwdgrad
  Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch
  ☆114Updated 2 years ago
• aks2203 / deep-thinking
  A centralized place for deep thinking code and experiments
  ☆88Updated 2 years ago
• Johswald / awesome-hypernetworks
  ☆67Updated 4 years ago
• ml-research / rational_activations
  Rational Activation Functions - Replacing Padé Activation Units
  ☆103Updated 9 months ago
• yu-rp / KANbeFair
  A More Fair and Comprehensive Comparison between KAN and MLP
  ☆176Updated last year
• Ping-C / optimizer
  This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…
  ☆40Updated 2 years ago
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆211Updated 2 months ago