Alternatives and similar repositories for pretraining-learning-curves

Users that are interested in pretraining-learning-curves are comparing it to the libraries listed below

• cambridgeltl / parameter-factorization
  Factorization of the neural parameter space for zero-shot multi-lingual and multi-task transfer
  ☆39Updated 5 years ago
• seraphlabs-ca / SentenceMIM-demo
  This repo contains code to reproduce some of the results presented in the paper "SentenceMIM: A Latent Variable Language Model"
  ☆28Updated 3 years ago
• TurkuNLP / wikibert
  BERT models for many languages created from Wikipedia texts
  ☆33Updated 5 years ago
• google-research-datasets / Disfl-QA
  A Benchmark Dataset for Understanding Disfluencies in Question Answering
  ☆64Updated 4 years ago
• huggingface / adversarialnlp
  A generic library for crafting adversarial NLP examples - WIP
  ☆41Updated 7 years ago
• rajammanabrolu / Q-BERT
  Agents that build knowledge graphs and explore textual worlds by asking questions
  ☆79Updated 2 years ago
• mandarjoshi90 / pair2vec
  pair2vec: Compositional Word-Pair Embeddings for Cross-Sentence Inference
  ☆61Updated 2 years ago
• huggingface / model_card
  ☆30Updated 4 years ago
• allenai / pybart
  Converter from UD-trees to BART representation
  ☆36Updated last year
• mayhewsw / pytorch-truecaser
  A simple neural truecaser written in pytorch and allennlp.
  ☆33Updated last year
• tm4roon / survey
  Survey on machine learning.
  ☆14Updated 4 years ago
• ofirpress / sandwich_transformer
  This repository contains the code for running the character-level Sandwich Transformers from our ACL 2020 paper on Improving Transformer …
  ☆55Updated 4 years ago
• hsha0 / electra
  ELECTRA MODEL NLP
  ☆13Updated 5 years ago
• carolinlawrence / BiSon
  Code for bidirectional sequence generation (BiSon) for generating from BERT pre-trained models.
  ☆51Updated 5 years ago
• shoarora / transformers-trainers
  Tools for training pytorch language models
  ☆27Updated 4 years ago
• spyysalo / wiki-bert-pipeline
  Generate BERT vocabularies and pretraining examples from Wikipedias
  ☆17Updated 5 years ago
• Kaleidophon / token2index
  A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and …
  ☆51Updated 10 months ago
• harvardnlp / hmm-lm
  ☆41Updated 4 years ago
• TimDettmers / transformer-xl
  ☆63Updated 5 years ago
• ofirpress / shortformer
  Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.
  ☆147Updated 4 years ago
• cgraywang / transformer-on-diet
  Code repo for "Transformer on a Diet" paper
  ☆31Updated 5 years ago
• BramVanroy / spacy-extreme
  An example of how to use spaCy for extremely large files without running into memory issues
  ☆36Updated 3 years ago
• MilaNLProc / bertlang
  A web interface to understand language-specific BERT-models
  ☆18Updated last year
• tombosc / cpae
  Code for EMNLP 2018 paper "Auto-Encoding Dictionary Definitions into Consistent Word Embeddings"
  ☆36Updated 7 years ago
• yanaiela / num_fh
  numeric fused-head identification and resolution
  ☆33Updated 6 years ago
• ltgoslo / simple_elmo_training
  Minimal code to train ELMo models in recent versions of TensorFlow
  ☆14Updated 2 years ago
• ART-Group-it / KERMIT
  🐸 KERMIT - A lightweight library to encode and interpret Universal Syntactic Embeddings
  ☆58Updated 2 years ago
• jwieting / paraphrastic-representations-at-scale
  ☆75Updated 4 years ago
• gsarti / lambda-bert
  A 🤗-style implementation of BERT using lambda layers instead of self-attention
  ☆69Updated 5 years ago
• allenai / tpu_pretrain
  LM Pretraining with PyTorch/TPU
  ☆136Updated 6 years ago