Alternatives and similar repositories for bert-distillation:

Users that are interested in bert-distillation are comparing it to the libraries listed below

• elephantmipt / compressors
  A small library with distillation, quantization and pruning pipelines
  ☆26Updated 4 years ago
• alexeykarnachev / full_stack_transformer
  Pytorch library for end-to-end transformer models training, inference and serving
  ☆70Updated 2 weeks ago
• Yorko / gender-unbiased_BERT-based_pronoun_resolution
  Source code for the ACL workshop paper and Kaggle competition by Google AI team
  ☆40Updated 3 years ago
• eatsleepraverepeat / reMUDE
  (re)Implementation of Learning Multi-level Dependencies for Robust Word Recognition
  ☆17Updated 9 months ago
• vklabmipt / implicit-unlikelihood-training
  Improving Neural Text Generation with Reinforcement Learning
  ☆22Updated 4 years ago
• s-nlp / annotated-transformer
  http://nlp.seas.harvard.edu/2018/04/03/attention.html
  ☆62Updated 3 years ago
• dayyass / QaNER
  Unofficial implementation of QaNER: Prompting Question Answering Models for Few-shot Named Entity Recognition.
  ☆66Updated 2 years ago
• vlarine / ruberta
  Russian RoBERTa
  ☆29Updated 5 years ago
• mera-company / nlp-embeddings-visualizer
  ☆31Updated 5 years ago
• uds-lsv / bert-stable-fine-tuning
  On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines
  ☆136Updated last year
• allenai / tpu_pretrain
  LM Pretraining with PyTorch/TPU
  ☆134Updated 5 years ago
• alexeyev / abae-pytorch
  PyTorch implementation of 'An Unsupervised Neural Attention Model for Aspect Extraction' by He et al. ACL2017'
  ☆66Updated 3 years ago
• PierreColombo / RankingNLPSystems
  What are the best Systems? New Perspectives on NLP Benchmarking
  ☆13Updated 2 years ago
• nreimers / se-pytorch-xla
  ☆21Updated 3 years ago
• dsindex / iclassifier
  reference pytorch code for intent classification
  ☆44Updated 6 months ago
• Guzpenha / transformer_rankers
  A library to conduct ranking experiments with transformers.
  ☆161Updated last year
• ispras-texterra / derek
  DEREK (Domain Entities and Relations Extraction Kit)
  ☆10Updated last year
• allenai / sledgehammer
  ☆47Updated 4 years ago
• ofirpress / shortformer
  Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.
  ☆147Updated 3 years ago
• JulesBelveze / bert-squeeze
  🛠️ Tools for Transformers compression using PyTorch Lightning ⚡
  ☆83Updated 5 months ago
• gsarti / lambda-bert
  A 🤗-style implementation of BERT using lambda layers instead of self-attention
  ☆69Updated 4 years ago
• s-nlp / mutual_implication_score
  ☆12Updated 2 years ago
• ltgoslo / simple_elmo
  Simple library to work with pre-trained ELMo models in TensorFlow
  ☆52Updated last year
• snakers4 / cft-contest-2018
  Repository with illustrations for cft-contest-2018
  ☆12Updated 6 years ago
• mertensu / transformer-tutorial
  Visualising the Transformer encoder
  ☆111Updated 4 years ago
• yang-zhang / lightning-language-modeling
  Language Modeling Example with Transformers and PyTorch Lighting
  ☆65Updated 4 years ago
• cambridgeltl / parameter-factorization
  Factorization of the neural parameter space for zero-shot multi-lingual and multi-task transfer
  ☆39Updated 4 years ago
• lucidrains / coco-lm-pytorch
  Implementation of COCO-LM, Correcting and Contrasting Text Sequences for Language Model Pretraining, in Pytorch
  ☆45Updated 4 years ago
• fostroll / junky
  Layers, datasets and utilities for PyTorch
  ☆10Updated last year
• huggingface / tune
  ☆87Updated 2 years ago