Alternatives and similar repositories for nerva:

Users that are interested in nerva are comparing it to the libraries listed below

• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆78Updated last year
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆47Updated last year
• shikaiqiu / compute-better-spent
  ☆52Updated 6 months ago
• mayank31398 / ladder-residual-inference
  ☆13Updated last week
• IST-DASLab / sparseprop
  ☆13Updated last year
• facebookexperimental / protoquant
  Prototype routines for GPU quantization written using PyTorch.
  ☆20Updated last month
• Ryu1845 / hyena-jax
  Implementation of Hyena Hierarchy in JAX
  ☆10Updated last year
• CerebrasResearch / Sparse-IFT
  Official repository of Sparse ISO-FLOP Transformations for Maximizing Training Efficiency
  ☆25Updated 8 months ago
• UmerHA / triton_util
  Make triton easier
  ☆47Updated 9 months ago
• softmax1 / Flash-Attention-Softmax-N
  CUDA and Triton implementations of Flash Attention with SoftmaxN.
  ☆68Updated 10 months ago
• lianakoleva / no-libtorch-compile
  ☆21Updated last month
• google-deepmind / asyncdiloco
  ☆43Updated last year
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆26Updated 5 months ago
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆36Updated last year
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆45Updated 8 months ago
• AllanYangZhou / universal_neural_functional
  ☆49Updated last year
• SamsungSAILMontreal / nino
  Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [to appear at ICLR 2025]
  ☆18Updated 3 weeks ago
• emalach / LinearLM
  Code for the paper: https://arxiv.org/pdf/2309.06979.pdf
  ☆19Updated 8 months ago
• irhum / hyena
  JAX/Flax implementation of the Hyena Hierarchy
  ☆34Updated last year
• aniquetahir / JORA
  JORA: JAX Tensor-Parallel LoRA Library (ACL 2024)
  ☆33Updated 11 months ago
• spcl / daceml
  A Data-Centric Compiler for Machine Learning
  ☆82Updated last year
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆125Updated 4 months ago
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆108Updated 3 months ago
• ezyang / torchdbg
  PyTorch centric eager mode debugger
  ☆46Updated 3 months ago
• leloykun / modded-nanogpt
  NanoGPT (124M) quality in 2.67B tokens
  ☆28Updated last month
• Z-T-WANG / LaProp-Optimizer
  Codes accompanying the paper "LaProp: a Better Way to Combine Momentum with Adaptive Gradient"
  ☆28Updated 4 years ago
• joey00072 / microjax
  Jax like function transformation engine but micro, microjax
  ☆30Updated 5 months ago
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆25Updated last year
• epoch-research / Compute-Trends
  Supplementary material for our paper "Compute Trends Across Three Eras of Machine Learning".
  ☆40Updated 3 years ago
• gau-nernst / quantized-training
  Explore training for quantized models
  ☆17Updated 2 months ago