yvrjsharma / JAX
☆13Updated 2 years ago
Related projects: ⓘ
- HomebrewNLP in JAX flavour for maintable TPU-Training☆46Updated 8 months ago
- Contains my experiments with the `big_vision` repo to train ViTs on ImageNet-1k.☆22Updated last year
- NLP Examples using the 🤗 libraries☆42Updated 3 years ago
- A case study of efficient training of large language models using commodity hardware.☆68Updated 2 years ago
- Yet another mini autodiff system for educational purposes☆26Updated 9 months ago
- ☆27Updated this week
- This repository contains example code to build models on TPUs☆30Updated last year
- ☆56Updated 2 years ago
- Various transformers for FSDP research☆31Updated last year
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆33Updated last year
- A collection of Models, Datasets, DataModules, Callbacks, Metrics, Losses and Loggers to better integrate pytorch-lightning with transfor…☆47Updated last year
- A 🤗-style implementation of BERT using lambda layers instead of self-attention☆70Updated 3 years ago
- Another attempt at a long-context / efficient transformer by me☆37Updated 2 years ago
- Python Research Framework☆107Updated last year
- Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…☆22Updated 5 months ago
- Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.☆146Updated 3 years ago
- ☆38Updated last year
- Dense Passage Retrieval using tensorflow-keras on TPU☆15Updated 3 years ago
- Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP☆58Updated 2 years ago
- A generative modelling toolkit for PyTorch.☆70Updated 2 years ago
- This repository hosts the code to port NumPy model weights of BiT-ResNets to TensorFlow SavedModel format.☆14Updated 2 years ago
- Fastai community entry to 2020 Reproducibility Challenge☆17Updated last year
- ☆27Updated last year
- A deep learning library based on Pytorch focussed on low resource language research and robustness☆69Updated 2 years ago
- My explorations into editing the knowledge and memories of an attention network☆34Updated last year
- Re-implementation of 'Grokking: Generalization beyond overfitting on small algorithmic datasets'☆38Updated 2 years ago
- ☆27Updated 4 months ago
- Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)☆184Updated 2 years ago
- Amos optimizer with JEstimator lib.☆79Updated 4 months ago