Alternatives and similar repositories for bert-distillation

Users that are interested in bert-distillation are comparing it to the libraries listed below

• elephantmipt / compressors
  A small library with distillation, quantization and pruning pipelines
  ☆26Updated 4 years ago
• Geotrend-research / smaller-transformers
  Load What You Need: Smaller Multilingual Transformers for Pytorch and TensorFlow 2.0.
  ☆105Updated 3 years ago
• uds-lsv / bert-stable-fine-tuning
  On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines
  ☆137Updated last year
• JulesBelveze / bert-squeeze
  🛠️ Tools for Transformers compression using PyTorch Lightning ⚡
  ☆84Updated 8 months ago
• alexeykarnachev / full_stack_transformer
  Pytorch library for end-to-end transformer models training, inference and serving
  ☆70Updated 3 months ago
• allenai / tpu_pretrain
  LM Pretraining with PyTorch/TPU
  ☆135Updated 5 years ago
• ofirpress / shortformer
  Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.
  ☆147Updated 4 years ago
• gsarti / lambda-bert
  A 🤗-style implementation of BERT using lambda layers instead of self-attention
  ☆69Updated 4 years ago
• davidalami / ConveRT
  Dual Encoders for State-of-the-art Natural Language Processing.
  ☆61Updated 2 years ago
• s-nlp / annotated-transformer
  http://nlp.seas.harvard.edu/2018/04/03/attention.html
  ☆62Updated 4 years ago
• nreimers / se-pytorch-xla
  ☆21Updated 3 years ago
• dsindex / iclassifier
  reference pytorch code for intent classification
  ☆44Updated 9 months ago
• huggingface / tune
  ☆87Updated 3 years ago
• microsoft / xtreme-distil-transformers
  XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale
  ☆155Updated last year
• microsoft / Distilled-Sentence-Embedding
  Scalable Attentive Sentence-Pair Modeling via Distilled Sentence Embedding (AAAI 2020) - PyTorch Implementation
  ☆32Updated 2 years ago
• prajjwal1 / fluence
  A deep learning library based on Pytorch focussed on low resource language research and robustness
  ☆70Updated 3 years ago
• dayyass / QaNER
  Unofficial implementation of QaNER: Prompting Question Answering Models for Few-shot Named Entity Recognition.
  ☆65Updated 2 years ago
• snakers4 / cft-contest-2018
  Repository with illustrations for cft-contest-2018
  ☆12Updated 6 years ago
• Yorko / gender-unbiased_BERT-based_pronoun_resolution
  Source code for the ACL workshop paper and Kaggle competition by Google AI team
  ☆41Updated 3 years ago
• yandex-research / graph-glove
  PyTorch code for the EMNLP 2020 paper "Embedding Words in Non-Vector Space with Unsupervised Graph Learning"
  ☆41Updated 4 years ago
• sobamchan / pytorch-lightning-transformers
  Fine-tune transformers with pytorch-lightning
  ☆44Updated 3 years ago
• gcunhase / StackedDeBERT
  Stacked Denoising BERT for Noisy Text Classification (Neural Networks 2020)
  ☆32Updated 2 years ago
• gsarti / t5-flax-gcp
  Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP
  ☆58Updated 3 years ago
• Guzpenha / transformer_rankers
  A library to conduct ranking experiments with transformers.
  ☆159Updated 2 years ago
• spyysalo / wiki-bert-pipeline
  Generate BERT vocabularies and pretraining examples from Wikipedias
  ☆18Updated 5 years ago
• wangcongcong123 / ttt
  A package for fine-tuning Transformers with TPUs, written in Tensorflow2.0+
  ☆37Updated 4 years ago
• jwieting / paraphrastic-representations-at-scale
  ☆75Updated 4 years ago
• eatsleepraverepeat / reMUDE
  (re)Implementation of Learning Multi-level Dependencies for Robust Word Recognition
  ☆17Updated last year
• FreddeFrallan / Contrastive-Tension
  State of the art Semantic Sentence Embeddings
  ☆99Updated 3 years ago
• huggingface / datasets-viewer
  Viewer for the 🤗 datasets library.
  ☆84Updated 4 years ago