pytorch-tpu / examples

Related projects ⓘ

Alternatives and complementary repositories for examples

• HomebrewNLP / HomebrewNLP
  A case study of efficient training of large language models using commodity hardware.
  ☆68Updated 2 years ago
• nikitakit / sabertooth
  Standalone pre-training recipe with JAX+Flax
  ☆31Updated last year
• HomebrewNLP / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆46Updated 10 months ago
• huggingface / tune
  ☆86Updated 2 years ago
• iKernels / transformers-lightning
  A collection of Models, Datasets, DataModules, Callbacks, Metrics, Losses and Loggers to better integrate pytorch-lightning with transfor…
  ☆47Updated last year
• YeonwooSung / GLOM
  PyTorch implementation of GLOM
  ☆21Updated 2 years ago
• lessw2020 / transformer_central
  Various transformers for FSDP research
  ☆33Updated 2 years ago
• stas00 / porting
  Helper scripts and notes that were used while porting various nlp models
  ☆44Updated 2 years ago
• tmabraham / fastai_tpu
  TPU support for the fastai library
  ☆13Updated 3 years ago
• tensorfork / OBST
  Your fruity companion for transformers
  ☆14Updated 2 years ago
• r0mainK / outperformer
  Code for scaling Transformers
  ☆26Updated 3 years ago
• tchaton / lightning-hydra-seed
  Pytorch Lightning seed project with hydra
  ☆18Updated 4 years ago
• cgraywang / transformer-on-diet
  Code repo for "Transformer on a Diet" paper
  ☆31Updated 4 years ago
• Ankur3107 / dpr-tf
  Dense Passage Retrieval using tensorflow-keras on TPU
  ☆15Updated 3 years ago
• srush / transformers-bet
  ☆12Updated 2 years ago
• google-research / precondition
  ☆29Updated 3 weeks ago
• allenai / sledgehammer
  ☆47Updated 4 years ago
• jph00 / hello_nbdev
  A tutorial example for nbdev
  ☆15Updated 2 years ago
• shawwn / ml-notes
  ☆38Updated last year
• krandiash / quinine
  A library to create and manage configuration files, especially for machine learning projects.
  ☆77Updated 2 years ago
• williamFalcon / minGPT
  A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
  ☆26Updated 2 years ago
• allenai / tpu_pretrain
  LM Pretraining with PyTorch/TPU
  ☆132Updated 5 years ago
• sholtodouglas / scalingExperiments
  ☆57Updated 2 years ago
• yiyixuxu / n-grammer-flax
  Implementation of N-Grammer in Flax
  ☆16Updated 2 years ago
• nreimers / se-pytorch-xla
  ☆21Updated 3 years ago
• shawwn / tpunicorn
  Babysit your preemptible TPUs
  ☆84Updated last year
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆92Updated last year
• antofuller / configaformers
  A python library for highly configurable transformers - easing model architecture search and experimentation.
  ☆49Updated 2 years ago
• ofirpress / sandwich_transformer
  This repository contains the code for running the character-level Sandwich Transformers from our ACL 2020 paper on Improving Transformer …
  ☆55Updated 3 years ago