Alternatives and similar repositories for bert-distillation

Users that are interested in bert-distillation are comparing it to the libraries listed below

• elephantmipt / compressors
  A small library with distillation, quantization and pruning pipelines
  ☆26Updated 4 years ago
• alexeykarnachev / full_stack_transformer
  Pytorch library for end-to-end transformer models training, inference and serving
  ☆70Updated 8 months ago
• allenai / tpu_pretrain
  LM Pretraining with PyTorch/TPU
  ☆137Updated 6 years ago
• Geotrend-research / smaller-transformers
  Load What You Need: Smaller Multilingual Transformers for Pytorch and TensorFlow 2.0.
  ☆105Updated 3 years ago
• uds-lsv / bert-stable-fine-tuning
  On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines
  ☆137Updated 2 years ago
• JulesBelveze / bert-squeeze
  🛠️ Tools for Transformers compression using PyTorch Lightning ⚡
  ☆85Updated this week
• huggingface / tune
  ☆87Updated 3 years ago
• snakers4 / cft-contest-2018
  Repository with illustrations for cft-contest-2018
  ☆12Updated 7 years ago
• prajjwal1 / fluence
  A deep learning library based on Pytorch focussed on low resource language research and robustness
  ☆70Updated 4 years ago
• ofirpress / shortformer
  Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.
  ☆147Updated 4 years ago
• microsoft / xtreme-distil-transformers
  XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale
  ☆157Updated 2 years ago
• spyysalo / wiki-bert-pipeline
  Generate BERT vocabularies and pretraining examples from Wikipedias
  ☆17Updated 5 years ago
• davidalami / ConveRT
  Dual Encoders for State-of-the-art Natural Language Processing.
  ☆60Updated 3 years ago
• yandex-research / graph-glove
  PyTorch code for the EMNLP 2020 paper "Embedding Words in Non-Vector Space with Unsupervised Graph Learning"
  ☆41Updated 4 years ago
• vklabmipt / implicit-unlikelihood-training
  Improving Neural Text Generation with Reinforcement Learning
  ☆22Updated 5 years ago
• s-nlp / annotated-transformer
  http://nlp.seas.harvard.edu/2018/04/03/attention.html
  ☆62Updated 4 years ago
• dsindex / iclassifier
  reference pytorch code for intent classification
  ☆44Updated last year
• Kaleidophon / token2index
  A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and …
  ☆51Updated last year
• cccwam / rc2020_electra
  ML Reproducibility Challenge 2020: Electra reimplementation using PyTorch and Transformers
  ☆12Updated 4 years ago
• microsoft / Distilled-Sentence-Embedding
  Scalable Attentive Sentence-Pair Modeling via Distilled Sentence Embedding (AAAI 2020) - PyTorch Implementation
  ☆34Updated 2 years ago
• gsarti / lambda-bert
  A 🤗-style implementation of BERT using lambda layers instead of self-attention
  ☆69Updated 5 years ago
• eatsleepraverepeat / reMUDE
  (re)Implementation of Learning Multi-level Dependencies for Robust Word Recognition
  ☆17Updated last year
• AranKomat / adapinp
  Unofficial implementation of Adaptive Input in PyTorch
  ☆12Updated 6 years ago
• gsarti / t5-flax-gcp
  Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP
  ☆58Updated 3 years ago
• yang-zhang / lightning-language-modeling
  Language Modeling Example with Transformers and PyTorch Lighting
  ☆65Updated 5 years ago
• cceyda / lit-NER
  TorchServe+Streamlit for easily serving your HuggingFace NER models
  ☆33Updated 3 years ago
• sobamchan / pytorch-lightning-transformers
  Fine-tune transformers with pytorch-lightning
  ☆44Updated 3 years ago
• nreimers / se-pytorch-xla
  ☆21Updated 4 years ago
• Yorko / gender-unbiased_BERT-based_pronoun_resolution
  Source code for the ACL workshop paper and Kaggle competition by Google AI team
  ☆41Updated 4 years ago
• huggingface / datasets-viewer
  Viewer for the 🤗 datasets library.
  ☆86Updated 4 years ago