tanmoyio / sahajBERTLinks
☆14Updated 3 years ago
Alternatives and similar repositories for sahajBERT
Users that are interested in sahajBERT are comparing it to the libraries listed below
Sorting:
- This repository contains example code to build models on TPUs☆30Updated 2 years ago
- A case study of efficient training of large language models using commodity hardware.☆68Updated 3 years ago
- Memory-efficient transformer. Work in progress.☆19Updated 2 years ago
- Implementation of Feedback Transformer in Pytorch☆107Updated 4 years ago
- A collection of Models, Datasets, DataModules, Callbacks, Metrics, Losses and Loggers to better integrate pytorch-lightning with transfor…☆47Updated 2 years ago
- Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.☆147Updated 4 years ago
- HetSeq: Distributed GPU Training on Heterogeneous Infrastructure☆106Updated 2 years ago
- Official code for "Distributed Deep Learning in Open Collaborations" (NeurIPS 2021)☆117Updated 3 years ago
- Simple tooling for marking deprecated functions or classes and re-routing to the new successors' instance.☆50Updated last week
- PyTorch implementation of L2L execution algorithm☆107Updated 2 years ago
- ☆153Updated 5 years ago
- http://nlp.seas.harvard.edu/2018/04/03/attention.html☆62Updated 4 years ago
- GPT, but made only out of MLPs☆89Updated 4 years ago
- Learning to Initialize Neural Networks for Stable and Efficient Training☆139Updated 3 years ago
- Toy implementations of some popular ML optimizers using Python/JAX☆44Updated 4 years ago
- A GPT, made only of MLPs, in Jax☆58Updated 4 years ago
- Training Transformer-XL on 128 GPUs☆140Updated 5 years ago
- Implements sharpness-aware minimization (https://arxiv.org/abs/2010.01412) in TensorFlow 2.☆60Updated 3 years ago
- Python Research Framework☆106Updated 2 years ago
- Configure Python functions explicitly and safely☆126Updated 8 months ago
- Speeech Recognition for Indic languages.☆13Updated 4 years ago
- Your fruity companion for transformers☆15Updated 3 years ago
- ☆64Updated 5 years ago
- EfficientNet, MobileNetV3, MobileNetV2, MixNet, etc in JAX w/ Flax Linen and Objax☆128Updated last year
- TPU index is a package for fast similarity search over large collections of high dimension vectors on TPUs☆17Updated 3 years ago
- Instantly improve your training performance of TensorFlow models with just 2 lines of code!☆106Updated 3 years ago
- ☆103Updated 4 years ago
- Manifold-Mixup implementation for fastai V1☆19Updated 4 years ago
- ☆13Updated 5 years ago
- Trains Transformer model variants. Data isn't shuffled between batches.☆143Updated 2 years ago