Alternatives and similar repositories for mezo-jax

Users that are interested in mezo-jax are comparing it to the libraries listed below

• gregorbachmann / scaling_mlps
  ☆51Updated last year
• dylandoblar / noether-networks
  Meta-learning inductive biases in the form of useful conserved quantities.
  ☆37Updated 2 years ago
• aks2203 / easy-to-hard
  Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"
  ☆59Updated 3 years ago
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆87Updated last year
• google-deepmind / spectral_ssm
  ☆34Updated last year
• AndPotap / einsum-search
  ☆32Updated 11 months ago
• shikaiqiu / compute-better-spent
  ☆57Updated 11 months ago
• yilundu / irem_code_release
  ICML 2022: Learning Iterative Reasoning through Energy Minimization
  ☆47Updated 2 years ago
• AllanYangZhou / universal_neural_functional
  ☆52Updated last year
• sustcsonglin / gated_linear_attention_layer
  ☆32Updated last year
• Ping-C / optimizer
  This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…
  ☆38Updated 2 years ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆80Updated last year
• srush / tangent
  Source-to-Source Debuggable Derivatives in Pure Python
  ☆15Updated last year
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆48Updated last year
• smonsays / hypernetwork-attention
  Official code for the paper "Attention as a Hypernetwork"
  ☆40Updated last year
• brendel-group / compositional-ood-generalization
  Official code for the paper "Compositional Generalization from First Principles" (NeurIPS 2023)
  ☆11Updated 2 years ago
• edwardmilsom / function-space-learning-rates-paper
  Code for the paper "Function-Space Learning Rates"
  ☆23Updated 3 months ago
• edwardjhu / TP4
  Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)
  ☆62Updated 4 years ago
• AhmedImtiazPrio / grok-adversarial
  Deep Networks Grok All the Time and Here is Why
  ☆37Updated last year
• BYU-PCCL / prompt-compression-contrastive-coding
  Companion repository to "Prompt Compression and Contrastive Conditioning for Controllability and Toxicity Reduction in Language Models"
  ☆14Updated 2 years ago
• tech-srl / layer_norm_expressivity_role
  Code for the paper "On the Expressivity Role of LayerNorm in Transformers' Attention" (Findings of ACL'2023)
  ☆56Updated 11 months ago
• radarFudan / mamba-minimal-jax
  ☆32Updated 9 months ago
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated last year
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆45Updated last year
• ClashLuke / tpucare
  Automatically take good care of your preemptible TPUs
  ☆36Updated 2 years ago
• glassroom / heinsen_sequence
  Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)
  ☆94Updated 8 months ago
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆46Updated last year
• dvruette / barrel-rec-pytorch
  ☆53Updated last year
• srush / mamba-scans
  Blog post
  ☆17Updated last year
• lucidrains / autoregressive-linear-attention-cuda
  CUDA implementation of autoregressive linear attention, with all the latest research findings
  ☆44Updated 2 years ago