Alternatives and similar repositories for C4AI-Scholars-Challenge

Users that are interested in C4AI-Scholars-Challenge are comparing it to the libraries listed below

• HomebrewML / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆50Updated last year
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated last year
• ml-gde / jflux
  JAX Implementation of Black Forest Labs' Flux.1 family of models
  ☆33Updated 7 months ago
• apoorvkh / torchrunx
  Easily run PyTorch on multiple GPUs & machines
  ☆46Updated 2 months ago
• CLAIRE-Labo / flash_attention
  A basic pure pytorch implementation of flash attention
  ☆16Updated 7 months ago
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆82Updated last year
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆127Updated last year
• google-deepmind / transformer_grammars
  Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale, TACL (2022)
  ☆126Updated 7 months ago
• huggingface / ml-agents
  Unity Machine Learning Agents Toolkit
  ☆48Updated 2 years ago
• sayakpaul / big_vision_experiments
  Contains my experiments with the `big_vision` repo to train ViTs on ImageNet-1k.
  ☆22Updated 2 years ago
• ThinamXx / build-GPT
  Building GPT ...
  ☆17Updated 6 months ago
• srush / mamba-primer
  ☆37Updated last year
• lucidrains / einops-exts
  Implementation of some personal helper functions for Einops, my most favorite tensor manipulation library ❤️
  ☆53Updated 2 years ago
• ClashLuke / tpucare
  Automatically take good care of your preemptible TPUs
  ☆36Updated 2 years ago
• huggingface / competitions
  ☆124Updated 7 months ago
• HomebrewML / HomebrewNLP-torch
  A case study of efficient training of large language models using commodity hardware.
  ☆69Updated 2 years ago
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆61Updated last year
• nateraw / huggingface-datasets-converter
  Scripts to convert datasets from various sources to Hugging Face Datasets.
  ☆57Updated 2 years ago
• srush / Tensor-Puzzles-Penzai
  ☆20Updated last year
• rovle / gpt3-in-context-fitting
  Experiments on GPT-3's ability to fit numerical models in-context.
  ☆14Updated 2 years ago
• samblouir / birdie
  ☆13Updated last week
• matthias-wright / jax-fid
  FID computation in Jax/Flax.
  ☆27Updated 10 months ago
• Rallio67 / language-model-agents
  Experiments with generating opensource language model assistants
  ☆97Updated 2 years ago
• hundredblocks / large-model-parallelism
  Functional local implementations of main model parallelism approaches
  ☆95Updated 2 years ago
• cloneofsimo / scaling-guide
  WIP
  ☆93Updated 9 months ago
• fbarez / neuroplasticity
  ☆14Updated last year
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated last month
• gregorbachmann / scaling_mlps
  ☆51Updated 11 months ago
• cloneofsimo / min-fsdp
  ☆78Updated 11 months ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆48Updated last year