Alternatives and similar repositories for GCD

Users that are interested in GCD are comparing it to the libraries listed below

• edwardmilsom / function-space-learning-rates-paper
  Code for the paper "Function-Space Learning Rates"
  ☆23Updated 4 months ago
• HazyResearch / train-tk
  train with kittens!
  ☆63Updated last year
• srush / drop7
  ☆18Updated last year
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆27Updated last year
• AndPotap / einsum-search
  ☆33Updated last year
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆27Updated last year
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆20Updated 9 months ago
• probcomp / genlm-control
  ☆11Updated 6 months ago
• google-deepmind / spectral_ssm
  ☆34Updated last year
• srush / tangent
  Source-to-Source Debuggable Derivatives in Pure Python
  ☆15Updated last year
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆80Updated last year
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated last year
• belindal / state-tracking
  Code and data for paper "(How) do Language Models Track State?"
  ☆20Updated 7 months ago
• yixiaoer / tpu-training-example
  ☆15Updated last year
• Ryu1845 / hyena-jax
  Implementation of Hyena Hierarchy in JAX
  ☆10Updated 2 years ago
• shikaiqiu / compute-better-spent
  ☆58Updated last year
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆78Updated last year
• allenai / signal-and-noise
  Measuring the Signal to Noise Ratio in Language Model Evaluation
  ☆25Updated 2 months ago
• smonsays / hypernetwork-attention
  Official code for the paper "Attention as a Hypernetwork"
  ☆45Updated last year
• radarFudan / mamba-minimal-jax
  ☆34Updated 11 months ago
• vvvm23 / mezo-jax
  JAX implementation of "Fine-Tuning Language Models with Just Forward Passes"
  ☆19Updated 2 years ago
• emalach / LinearLM
  Code for the paper: https://arxiv.org/pdf/2309.06979.pdf
  ☆21Updated last year
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆84Updated last year
• yixiaoer / einshard
  Einsum-like high-level array sharding API for JAX
  ☆34Updated last year
• CLAIRE-Labo / flash_attention
  A basic pure pytorch implementation of flash attention
  ☆16Updated last year
• AllanYangZhou / universal_neural_functional
  ☆53Updated last year
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆48Updated last year
• HazyResearch / bwler
  Official repo for BWLer: Barycentric Weight Layer
  ☆23Updated last month
• Laz4rz / mup
  Minimal (truly) muP implementation, consistent with TP4 and TP5 papers notation
  ☆14Updated 5 months ago
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆68Updated 10 months ago