Alternatives and similar repositories for kanmlps

Users that are interested in kanmlps are comparing it to the libraries listed below

• johnma2006 / candle
  Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.
  ☆53Updated last year
• LucasPrietoAl / grokking-at-the-edge-of-numerical-stability
  ☆111Updated 6 months ago
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆93Updated 2 years ago
• shikaiqiu / compute-better-spent
  ☆62Updated last year
• GallagherCommaJack / modulax
  ☆18Updated last year
• yixiaoer / einshard
  Einsum-like high-level array sharding API for JAX
  ☆34Updated last year
• proger / accelerated-scan
  Accelerated First Order Parallel Associative Scan
  ☆196Updated last month
• ruke1ire / RTF
  A State-Space Model with Rational Transfer Function Representation.
  ☆83Updated last year
• modula-systems / modula
  🧱 Modula software package
  ☆322Updated 5 months ago
• nikhilvyas / SOAP
  ☆246Updated last year
• NicolasZucchet / minimal-LRU
  Non official implementation of the Linear Recurrent Unit (LRU, Orvieto et al. 2023)
  ☆61Updated 5 months ago
• Jaykef / Triton-nanoGPT
  Custom triton kernels for training Karpathy's nanoGPT.
  ☆19Updated last year
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆190Updated last month
• LIONS-EPFL / scion
  ☆53Updated last month
• opooladz / Preconditioned-Stochastic-Gradient-Descent
  A repo based on XiLin Li's PSGD repo that extends some of the experiments.
  ☆14Updated last year
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆137Updated last year
• johnryan465 / pscan
  ☆40Updated 2 years ago
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆186Updated 3 weeks ago
• radarFudan / mamba-minimal-jax
  ☆35Updated last year
• glassroom / heinsen_sequence
  Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)
  ☆98Updated last year
• KindXiaoming / Omnigrok
  Omnigrok: Grokking Beyond Algorithmic Data
  ☆62Updated 2 years ago
• erfanzar / jax-flash-attn2
  A flexible and efficient implementation of Flash Attention 2.0 for JAX, supporting multiple backends (GPU/TPU/CPU) and platforms (Triton/…
  ☆34Updated 11 months ago
• proger / hippogriff
  Griffin MQA + Hawk Linear RNN Hybrid
  ☆88Updated last year
• machine-discovery / deer
  Parallelizing non-linear sequential models over the sequence length
  ☆56Updated 7 months ago
• davisyoshida / qax
  If it quacks like a tensor...
  ☆59Updated last year
• JesseFarebro / flax-mup
  Maximal Update Parametrization (μP) with Flax & Optax.
  ☆16Updated 2 years ago
• marin-community / haliax
  Named Tensors for Legible Deep Learning in JAX
  ☆218Updated 3 months ago
• young-geng / scalax
  A simple library for scaling up JAX programs
  ☆145Updated 3 months ago
• NX-AI / flashrnn
  FlashRNN - Fast RNN Kernels with I/O Awareness
  ☆174Updated 3 months ago
• zaydzuhri / softpick-attention
  Landing repository for the paper "Softpick: No Attention Sink, No Massive Activations with Rectified Softmax"
  ☆86Updated 4 months ago