Alternatives and similar repositories for SONew:

Users that are interested in SONew are comparing it to the libraries listed below

• srush / mamba-scans
  Blog post
  ☆17Updated last year
• AndyShih12 / LongHorizonTemperatureScaling
  PyTorch implementation for "Long Horizon Temperature Scaling", ICML 2023
  ☆20Updated last year
• EdinburghNLP / torch-adaptive-imle
  ☆34Updated 3 months ago
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆16Updated 2 months ago
• formll / resolving-scaling-law-discrepancies
  ☆18Updated 8 months ago
• f-dangel / sirfshampoo
  [ICML 2024] SIRFShampoo: Structured inverse- and root-free Shampoo in PyTorch (https://arxiv.org/abs/2402.03496)
  ☆14Updated 4 months ago
• google-deepmind / spectral_ssm
  ☆31Updated 11 months ago
• ejmichaud / grokking-squared
  ☆24Updated 2 years ago
• SamsungSAILMontreal / nino
  Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [to appear at ICLR 2025]
  ☆18Updated 3 weeks ago
• rahul13ramesh / compositional_capabilities
  Compositional Capabilities of Autoregressive Transformers: A Study on Synthetic, Interpretable Tasks
  ☆10Updated 9 months ago
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆58Updated last year
• thudzj / ELLA
  Code for Accelerated Linearized Laplace Approximation for Bayesian Deep Learning (ELLA, NeurIPS 22')
  ☆16Updated 2 years ago
• AndPotap / einsum-search
  ☆30Updated 5 months ago
• peerdavid / layerwise-batch-entropy
  Layerwise Batch Entropy Regularization
  ☆22Updated 2 years ago
• radarFudan / mamba-minimal-jax
  ☆30Updated 4 months ago
• Z-T-WANG / LaProp-Optimizer
  Codes accompanying the paper "LaProp: a Better Way to Combine Momentum with Adaptive Gradient"
  ☆28Updated 4 years ago
• michaelsdr / sinkformers
  Transformers with doubly stochastic attention
  ☆45Updated 2 years ago
• IDSIA / recurrent-fwp
  Official repository for the paper "Going Beyond Linear Transformers with Recurrent Fast Weight Programmers" (NeurIPS 2021)
  ☆48Updated 2 years ago
• ryoungj / mcbits
  [ICML'21 Oral] Improving Lossless Compression Rates via Monte Carlo Bits-Back Coding
  ☆14Updated 3 years ago
• mfederici / dsit
  Implementation of the models and datasets used in "An Information-theoretic Approach to Distribution Shifts"
  ☆25Updated 3 years ago
• shikaiqiu / compute-better-spent
  ☆52Updated 5 months ago
• radarFudan / Curse-of-memory
  Curse-of-memory phenomenon of RNNs in sequence modelling
  ☆19Updated last week
• Yujun-Yan / Neural-Execution-Engines
  Code for Neural Execution Engines: Learning to Execute Subroutines
  ☆17Updated 4 years ago
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆36Updated last year
• proger / nanokitchen
  Parallel Associative Scan for Language Models
  ☆18Updated last year
• sustcsonglin / gated_linear_attention_layer
  ☆33Updated last year
• Doraemonzzz / hgru2-pytorch
  ☆23Updated 6 months ago
• maximzubkov / fft-scan
  Efficient PScan implementation in PyTorch
  ☆16Updated last year
• rovle / gpt3-in-context-fitting
  Experiments on GPT-3's ability to fit numerical models in-context.
  ☆14Updated 2 years ago
• franrruiz / augment-reduce
  Code for Augment & Reduce, a scalable stochastic algorithm for large categorical distributions
  ☆10Updated 6 years ago