rcrowe-google / Learning-JAXLinks
Slide decks, coding exercises, and quick references for learning the JAX AI Stack
☆33Updated last week
Alternatives and similar repositories for Learning-JAX
Users that are interested in Learning-JAX are comparing it to the libraries listed below
Sorting:
- A collection of reusable, high-performance, well-documented, thorough-tested layers and models in Jax☆20Updated 2 months ago
- ☆49Updated 9 months ago
- Various transformers for FSDP research☆38Updated 2 years ago
- Easily run PyTorch on multiple GPUs & machines☆46Updated last month
- ☆48Updated 11 months ago
- Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…☆27Updated last year
- Fast, Modern, and Low Precision PyTorch Optimizers☆108Updated 3 weeks ago
- ☆82Updated last year
- This repository shows various ways of deploying a vision model (TensorFlow) from 🤗 Transformers.☆30Updated 3 years ago
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆63Updated last week
- ☆56Updated 3 months ago
- ☆124Updated 9 months ago
- Efficient encoder-decoder architecture for small language models (≤1B parameters) with cross-architecture knowledge distillation and visi…☆29Updated 6 months ago
- Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*☆87Updated last year
- ☆31Updated 9 months ago
- ☆51Updated 6 months ago
- Supercharge huggingface transformers with model parallelism.☆77Updated last month
- some common Huggingface transformers in maximal update parametrization (µP)☆82Updated 3 years ago
- ☆29Updated 3 months ago
- MatFormer repo☆60Updated 8 months ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated 2 years ago
- Code for NeurIPS LLM Efficiency Challenge☆59Updated last year
- A fast implementation of T5/UL2 in PyTorch using Flash Attention☆107Updated 5 months ago
- Repository for "I am a Strange Dataset: Metalinguistic Tests for Language Models"☆44Updated last year
- ☆31Updated 4 months ago
- Tiled Flash Linear Attention library for fast and efficient mLSTM Kernels.☆69Updated last week
- ☆19Updated 2 years ago
- ☆80Updated 2 months ago
- ☆13Updated 8 months ago
- Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.☆158Updated last year