ahmadmustafaanis / C4AI-Scholars-ChallengeLinks
☆12Updated 2 years ago
Alternatives and similar repositories for C4AI-Scholars-Challenge
Users that are interested in C4AI-Scholars-Challenge are comparing it to the libraries listed below
Sorting:
- ☆210Updated last year
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Updated last year
- Easily run PyTorch on multiple GPUs & machines☆54Updated last week
- Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale, TACL (2022)☆133Updated last week
- ☆91Updated last year
- Train vision models using JAX and 🤗 transformers☆100Updated last month
- HomebrewNLP in JAX flavour for maintable TPU-Training☆51Updated last year
- Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)☆189Updated 3 years ago
- All about the fundamentals and working of Diffusion Models☆159Updated 2 years ago
- A case study of efficient training of large language models using commodity hardware.☆68Updated 3 years ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆35Updated 2 years ago
- Experiments on GPT-3's ability to fit numerical models in-context.☆14Updated 3 years ago
- ML/DL Math and Method notes☆64Updated 2 years ago
- Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.☆160Updated last year
- Contains my experiments with the `big_vision` repo to train ViTs on ImageNet-1k.☆22Updated 2 years ago
- Implementation of some personal helper functions for Einops, my most favorite tensor manipulation library ❤️☆57Updated 2 years ago
- Code for the paper "On the Expressivity Role of LayerNorm in Transformers' Attention" (Findings of ACL'2023)☆57Updated last year
- Experiment with diffusion models that you can run on your local jupyter instances☆63Updated last year
- ☆129Updated 2 years ago
- Resources from the EleutherAI Math Reading Group☆54Updated 9 months ago
- Implementation of a Transformer that Ponders, using the scheme from the PonderNet paper☆81Updated 4 years ago
- Automatically take good care of your preemptible TPUs☆37Updated 2 years ago
- ☆53Updated last year
- Experiments with generating opensource language model assistants☆97Updated 2 years ago
- Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…☆125Updated last year
- Minimum Bayes Risk Decoding for Hugging Face Transformers☆60Updated last year
- Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*☆87Updated 2 years ago
- ☆13Updated 3 years ago
- ☆124Updated last year
- ☆69Updated last year