Alternatives and similar repositories for SONew:

Users that are interested in SONew are comparing it to the libraries listed below

• google-deepmind / spectral_ssm
  ☆31Updated 10 months ago
• srush / mamba-scans
  Blog post
  ☆16Updated last year
• peerdavid / layerwise-batch-entropy
  Layerwise Batch Entropy Regularization
  ☆22Updated 2 years ago
• borjanG / 2023-transformers
  Codes for the paper The emergence of clusters in self-attention dynamics.
  ☆14Updated last year
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆58Updated last year
• CLAIRE-Labo / StructuredFFN
  The official code of "Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers"
  ☆17Updated 6 months ago
• EdinburghNLP / torch-adaptive-imle
  ☆34Updated 2 months ago
• Z-T-WANG / LaProp-Optimizer
  Codes accompanying the paper "LaProp: a Better Way to Combine Momentum with Adaptive Gradient"
  ☆27Updated 4 years ago
• opallab / positional_attention
  Source code for the paper "Positional Attention: Out-of-Distribution Generalization and Expressivity for Neural Algorithmic Reasoning"
  ☆14Updated 3 weeks ago
• radarFudan / Curse-of-memory
  Curse-of-memory phenomenon of RNNs in sequence modelling
  ☆19Updated this week
• ejmichaud / grokking-squared
  ☆24Updated 2 years ago
• thudzj / ELLA
  Code for Accelerated Linearized Laplace Approximation for Bayesian Deep Learning (ELLA, NeurIPS 22')
  ☆16Updated 2 years ago
• SamsungSAILMontreal / nino
  Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [to appear at ICLR 2025]
  ☆18Updated last month
• HazyResearch / prefix-linear-attention
  ☆49Updated 7 months ago
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆14Updated 3 weeks ago
• IDSIA / recurrent-fwp
  Official repository for the paper "Going Beyond Linear Transformers with Recurrent Fast Weight Programmers" (NeurIPS 2021)
  ☆48Updated last year
• shikaiqiu / compute-better-spent
  ☆52Updated 4 months ago
• IamHuijben / gumbel_softmax_sampling
  ☆11Updated 2 years ago
• Doraemonzzz / hgru2-pytorch
  ☆24Updated 4 months ago
• sustcsonglin / gated_linear_attention_layer
  ☆33Updated last year
• opooladz / Preconditioned-Stochastic-Gradient-Descent
  A repo based on XiLin Li's PSGD repo that extends some of the experiments.
  ☆14Updated 4 months ago
• maximzubkov / fft-scan
  Efficient PScan implementation in PyTorch
  ☆15Updated last year
• gebob19 / introduction_to_normalizing_flows
  Jupyter Notebook corresponding to 'Going with the Flow: An Introduction to Normalizing Flows'
  ☆25Updated 3 years ago
• ryoungj / mcbits
  [ICML'21 Oral] Improving Lossless Compression Rates via Monte Carlo Bits-Back Coding
  ☆14Updated 3 years ago
• prajjwal1 / rl_paradigm
  ☆15Updated last year
• proger / nanokitchen
  Parallel Associative Scan for Language Models
  ☆18Updated last year
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆28Updated last year
• facebookresearch / w2ot
  Euclidean Wasserstein-2 optimal transportation
  ☆44Updated last year
• michaelsdr / sinkformers
  Transformers with doubly stochastic attention
  ☆45Updated 2 years ago