Alternatives and similar repositories for liger_kernels:

Users that are interested in liger_kernels are comparing it to the libraries listed below

• srush / mamba-primer
  ☆37Updated 9 months ago
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆82Updated 11 months ago
• AndPotap / einsum-search
  ☆29Updated 3 months ago
• shikaiqiu / compute-better-spent
  ☆50Updated 3 months ago
• cloneofsimo / minSAE
  ☆24Updated last month
• ethansmith2000 / TransformerExperiments
  ☆19Updated 3 months ago
• thecharlieblake / lovely-llama
  An implementation of the Llama architecture, to instruct and delight
  ☆21Updated this week
• phlippe / jax_trainer
  Lightning-like training API for JAX with Flax
  ☆36Updated last month
• google-deepmind / spectral_ssm
  ☆31Updated 9 months ago
• lucaslingle / mu_transformer
  Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.
  ☆30Updated last month
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆58Updated 3 months ago
• srush / Tensor-Puzzles-Penzai
  ☆20Updated 8 months ago
• yixiaoer / mistral-v0.2-jax
  JAX implementation of the Mistral 7b v0.2 model
  ☆35Updated 6 months ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆40Updated 3 months ago
• sjelassi / transformers_ssm_copy
  ☆29Updated 10 months ago
• yixiaoer / einshard
  Einsum-like high-level array sharding API for JAX
  ☆33Updated 6 months ago
• ethansmith2000 / fsdp_optimizers
  supporting pytorch FSDP for optimizers
  ☆75Updated last month
• NVlabs / Forecasting-Model-Search
  A system for automating selection and optimization of pre-trained models from the TAO Model Zoo
  ☆24Updated 6 months ago
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆67Updated 2 months ago
• CLAIRE-Labo / flash_attention
  A basic pure pytorch implementation of flash attention
  ☆16Updated 2 months ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆74Updated 11 months ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆46Updated last year
• young-geng / mlxu
  Machine Learning eXperiment Utilities
  ☆45Updated 7 months ago
• SHI-Labs / CompactNet
  ☆30Updated 8 months ago
• berlino / seq_icl
  ☆51Updated 7 months ago
• evanatyourservice / llm-jax
  Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
  ☆14Updated this week
• radarFudan / mamba-minimal-jax
  ☆31Updated last month
• AakashKumarNain / mistral_jax
  This is a port of Mistral-7B model in JAX
  ☆30Updated 6 months ago
• NX-AI / flashrnn
  FlashRNN - Fast RNN Kernels with I/O Awareness
  ☆70Updated last month