Alternatives and similar repositories for Module-0:

Users that are interested in Module-0 are comparing it to the libraries listed below

• dpressel / mint
  MinT: Minimal Transformer Library and Tutorials
  ☆254Updated 2 years ago
• minitorch / minitorch.github.io
  Docs
  ☆143Updated 5 months ago
• irregular-rhomboid / EAI-Math-Reading-Group
  Resources from the EleutherAI Math Reading Group
  ☆53Updated 2 months ago
• LaihoE / did-it-spill
  Check if you have training samples in your test set
  ☆64Updated 2 years ago
• awf / functional-transformer
  A pure-functional implementation of a machine learning transformer model in Python/JAX
  ☆177Updated this week
• HomebrewML / HomebrewNLP-torch
  A case study of efficient training of large language models using commodity hardware.
  ☆69Updated 2 years ago
• srush / awesome-ml-tracking
  ☆103Updated 4 years ago
• srush / do-we-need-attention
  ☆166Updated last year
• google-deepmind / transformer_grammars
  Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale, TACL (2022)
  ☆125Updated 6 months ago
• facebookresearch / torchdim
  Named tensors with first-class dimensions for PyTorch
  ☆320Updated last year
• yifding / hetseq
  HetSeq: Distributed GPU Training on Heterogeneous Infrastructure
  ☆106Updated last year
• namedtensor / notation
  ☆108Updated 2 years ago
• srush / Autodiff-Puzzles
  ☆430Updated 6 months ago
• krandiash / quinine
  A library to create and manage configuration files, especially for machine learning projects.
  ☆78Updated 3 years ago
• srush / parallax
  ☆153Updated 4 years ago
• HomebrewML / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆50Updated last year
• n2cholas / shapecheck
  Framework-agnostic library for checking array/tensor shapes at runtime.
  ☆46Updated 4 years ago
• kingoflolz / swarm-jax
  Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes
  ☆238Updated last year
• lf1-io / padl
  Functional deep learning
  ☆108Updated 2 years ago
• EleutherAI / pyfra
  Python Research Framework
  ☆106Updated 2 years ago
• lucidrains / charformer-pytorch
  Implementation of the GBST block from the Charformer paper, in Pytorch
  ☆116Updated 3 years ago
• sholtodouglas / scalingExperiments
  ☆60Updated 3 years ago
• srush / Transformer-Puzzles
  Puzzles for exploring transformers
  ☆344Updated 2 years ago
• srush / raspy
  An interactive exploration of Transformer programming.
  ☆262Updated last year
• hundredblocks / large-model-parallelism
  Functional local implementations of main model parallelism approaches
  ☆95Updated 2 years ago
• allenai / tpu_pretrain
  LM Pretraining with PyTorch/TPU
  ☆134Updated 5 years ago
• srush / torch-golf
  Silly twitter torch implementations.
  ☆46Updated 2 years ago
• ofirpress / shortformer
  Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.
  ☆147Updated 3 years ago
• uclnlp / torch-imle
  Implicit MLE: Backpropagating Through Discrete Exponential Family Distributions
  ☆258Updated last year
• facebookresearch / dynalab
  The Python library with command line tools to interact with Dynabench(https://dynabench.org/), such as uploading models.
  ☆55Updated 2 years ago