Alternatives and similar repositories for C4AI-Scholars-Challenge

Users that are interested in C4AI-Scholars-Challenge are comparing it to the libraries listed below

• HomebrewML / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆50Updated last year
• google-deepmind / transformer_grammars
  Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale, TACL (2022)
  ☆128Updated 2 months ago
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆132Updated last year
• huggingface / chug
  Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.
  ☆158Updated last year
• BlackHC / neural_net_checklist
  ☆150Updated last year
• ariG23498 / timm-wrapper-examples
  Notebooks to demonstrate TimmWrapper
  ☆16Updated 7 months ago
• AakashKumarNain / diffusion_models
  All about the fundamentals and working of Diffusion Models
  ☆159Updated 2 years ago
• sayakpaul / big_vision_experiments
  Contains my experiments with the `big_vision` repo to train ViTs on ImageNet-1k.
  ☆22Updated 2 years ago
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated 2 years ago
• lucidrains / einops-exts
  Implementation of some personal helper functions for Einops, my most favorite tensor manipulation library ❤️
  ☆55Updated 2 years ago
• dpressel / mint
  MinT: Minimal Transformer Library and Tutorials
  ☆257Updated 3 years ago
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆63Updated last year
• cloneofsimo / min-fsdp
  ☆87Updated last year
• irregular-rhomboid / EAI-Math-Reading-Group
  Resources from the EleutherAI Math Reading Group
  ☆54Updated 6 months ago
• lucidrains / PaLM-jax
  Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)
  ☆188Updated 3 years ago
• warner-benjamin / commented-transformers
  Highly commented implementations of Transformers in PyTorch
  ☆136Updated 2 years ago
• aks2203 / easy-to-hard
  Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"
  ☆59Updated 3 years ago
• apoorvkh / torchrunx
  Easily run PyTorch on multiple GPUs & machines
  ☆47Updated 2 months ago
• cloneofsimo / scaling-guide
  WIP
  ☆94Updated last year
• borisdayma / clip-jax
  Train vision models using JAX and 🤗 transformers
  ☆99Updated last week
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆87Updated last year
• lucidrains / pytorch-custom-utils
  Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…
  ☆124Updated last year
• lucidrains / taylor-series-linear-attention
  Explorations into the recently proposed Taylor Series Linear Attention
  ☆100Updated last year
• yvrjsharma / JAX
  ☆13Updated 3 years ago
• apple / ml-sigma-reparam
  ☆307Updated last year
• google-deepmind / compressed_vision
  ☆130Updated 2 years ago
• epfml / DenseFormer
  ☆82Updated last year
• sholtodouglas / scalingExperiments
  ☆61Updated 3 years ago
• ml-gde / jflux
  JAX Implementation of Black Forest Labs' Flux.1 family of models
  ☆36Updated this week
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆86Updated 4 months ago