Alternatives and similar repositories for C4AI-Scholars-Challenge

Users that are interested in C4AI-Scholars-Challenge are comparing it to the libraries listed below

• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆132Updated last year
• google-deepmind / transformer_grammars
  Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale, TACL (2022)
  ☆133Updated last month
• cloneofsimo / min-fsdp
  ☆92Updated last year
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆65Updated 2 years ago
• lucidrains / PaLM-jax
  Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)
  ☆189Updated 3 years ago
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆35Updated 2 years ago
• huggingface / chug
  Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.
  ☆160Updated last year
• borisdayma / clip-jax
  Train vision models using JAX and 🤗 transformers
  ☆100Updated 3 weeks ago
• HomebrewML / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆51Updated last year
• apoorvkh / torchrunx
  Easily run PyTorch on multiple GPUs & machines
  ☆56Updated last month
• dpressel / mint
  MinT: Minimal Transformer Library and Tutorials
  ☆260Updated 3 years ago
• HomebrewML / HomebrewNLP-torch
  A case study of efficient training of large language models using commodity hardware.
  ☆68Updated 3 years ago
• AakashKumarNain / diffusion_models
  All about the fundamentals and working of Diffusion Models
  ☆159Updated 3 years ago
• sangmichaelxie / cs324_p2
  Project 2 (Building Large Language Models) for Stanford CS324: Understanding and Developing Large Language Models (Winter 2022)
  ☆105Updated 2 years ago
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆86Updated 2 years ago
• huggingface / competitions
  ☆125Updated last year
• huggingface / simulate
  🎢 Creating and sharing simulation environments for embodied and synthetic data research
  ☆192Updated 2 years ago
• kingoflolz / CLIP_JAX
  Contrastive Language-Image Pretraining
  ☆144Updated 3 years ago
• BlackHC / neural_net_checklist
  ☆212Updated last year
• google-deepmind / compressed_vision
  ☆130Updated 2 years ago
• irregular-rhomboid / EAI-Math-Reading-Group
  Resources from the EleutherAI Math Reading Group
  ☆54Updated 10 months ago
• EleutherAI / concept-erasure
  Erasing concepts from neural representations with provable guarantees
  ☆242Updated 11 months ago
• sayakpaul / big_vision_experiments
  Contains my experiments with the `big_vision` repo to train ViTs on ImageNet-1k.
  ☆22Updated 2 years ago
• ayaka14732 / llama-2-jax
  JAX implementation of the Llama 2 model
  ☆215Updated last year
• rovle / gpt3-in-context-fitting
  Experiments on GPT-3's ability to fit numerical models in-context.
  ☆14Updated 3 years ago
• r-three / git-theta
  git extension for {collaborative, communal, continual} model development
  ☆217Updated last year
• eemlcommunity / PracticalSessions2023
  ☆69Updated 2 years ago
• ClashLuke / tpucare
  Automatically take good care of your preemptible TPUs
  ☆37Updated 2 years ago
• apple / ml-sigma-reparam
  ☆314Updated last year
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆259Updated 2 years ago