Alternatives and similar repositories for sahajBERT

Users that are interested in sahajBERT are comparing it to the libraries listed below

• pytorch-tpu / examples
  This repository contains example code to build models on TPUs
  ☆30Updated 2 years ago
• HomebrewML / HomebrewNLP-torch
  A case study of efficient training of large language models using commodity hardware.
  ☆68Updated 3 years ago
• lucidrains / feedback-transformer-pytorch
  Implementation of Feedback Transformer in Pytorch
  ☆108Updated 4 years ago
• yandex-research / DeDLOC
  Official code for "Distributed Deep Learning in Open Collaborations" (NeurIPS 2021)
  ☆117Updated 3 years ago
• s-nlp / annotated-transformer
  http://nlp.seas.harvard.edu/2018/04/03/attention.html
  ☆62Updated 4 years ago
• TezRomacH / layer-to-layer-pytorch
  PyTorch implementation of L2L execution algorithm
  ☆109Updated 2 years ago
• artyompal / kaggle-abstract-reasoning
  Our solution of the Kaggle Abstraction and Reasoning Challenge
  ☆23Updated 5 years ago
• learning-at-home / lean_transformer
  Memory-efficient transformer. Work in progress.
  ☆19Updated 3 years ago
• lucidrains / g-mlp-gpt
  GPT, but made only out of MLPs
  ☆89Updated 4 years ago
• iKernels / transformers-lightning
  A collection of Models, Datasets, DataModules, Callbacks, Metrics, Losses and Loggers to better integrate pytorch-lightning with transfor…
  ☆47Updated 2 years ago
• zhuchen03 / gradinit
  Learning to Initialize Neural Networks for Stable and Efficient Training
  ☆139Updated 3 years ago
• lucidrains / mlp-gpt-jax
  A GPT, made only of MLPs, in Jax
  ☆58Updated 4 years ago
• ofirpress / shortformer
  Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.
  ☆147Updated 4 years ago
• RobertCsordas / transformer_generalization
  The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…
  ☆67Updated 2 years ago
• gsarti / lambda-bert
  A 🤗-style implementation of BERT using lambda layers instead of self-attention
  ☆69Updated 5 years ago
• sayakpaul / Sharpness-Aware-Minimization-TensorFlow
  Implements sharpness-aware minimization (https://arxiv.org/abs/2010.01412) in TensorFlow 2.
  ☆61Updated 4 years ago
• eyalbd2 / RL-based-Language-Modeling
  ☆13Updated 6 years ago
• srush / parallax
  ☆153Updated 5 years ago
• sayakpaul / BiT-jax2tf
  This repository hosts the code to port NumPy model weights of BiT-ResNets to TensorFlow SavedModel format.
  ☆14Updated 3 years ago
• Scitator / kittylyst
  A tiny Catalyst-like experiment runner framework on top of micrograd.
  ☆51Updated 4 years ago
• HomebrewML / revlib
  Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload
  ☆131Updated 3 years ago
• srush / awesome-ml-tracking
  ☆104Updated 4 years ago
• HomebrewML / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆51Updated last year
• Rishit-dagli / Gradient-Centralization-TensorFlow
  Instantly improve your training performance of TensorFlow models with just 2 lines of code!
  ☆105Updated 3 years ago
• nestordemeure / ManifoldMixup
  Manifold-Mixup implementation for fastai V1
  ☆19Updated 5 years ago
• Rishit-dagli / Perceiver
  Implementation of Perceiver, General Perception with Iterative Attention
  ☆87Updated 4 years ago
• r0mainK / outperformer
  Code for scaling Transformers
  ☆26Updated 5 years ago
• lf1-io / padl
  Functional deep learning
  ☆108Updated 3 years ago
• lucidrains / panoptic-transformer
  Another attempt at a long-context / efficient transformer by me
  ☆38Updated 3 years ago
• Borda / pyDeprecate
  Smoothly deprecate and redirect Python functions/classes with smart warnings and auto-routing—keep your codebase clean while maintaining …
  ☆51Updated this week