Alternatives and similar repositories for bert-distillation:

Users that are interested in bert-distillation are comparing it to the libraries listed below

• elephantmipt / compressors
  A small library with distillation, quantization and pruning pipelines
  ☆26Updated 3 years ago
• alexeykarnachev / full_stack_transformer
  Pytorch library for end-to-end transformer models training, inference and serving
  ☆70Updated 2 years ago
• Yorko / gender-unbiased_BERT-based_pronoun_resolution
  Source code for the ACL workshop paper and Kaggle competition by Google AI team
  ☆40Updated 3 years ago
• vlarine / ruberta
  Russian RoBERTa
  ☆29Updated 5 years ago
• s-nlp / annotated-transformer
  http://nlp.seas.harvard.edu/2018/04/03/attention.html
  ☆62Updated 3 years ago
• IINemo / active_learning_toolbox
  Jupyter active learning annotator widget.
  ☆22Updated 4 years ago
• Geotrend-research / smaller-transformers
  Load What You Need: Smaller Multilingual Transformers for Pytorch and TensorFlow 2.0.
  ☆102Updated 2 years ago
• eatsleepraverepeat / reMUDE
  (re)Implementation of Learning Multi-level Dependencies for Robust Word Recognition
  ☆17Updated 8 months ago
• alexeyev / abae-pytorch
  PyTorch implementation of 'An Unsupervised Neural Attention Model for Aspect Extraction' by He et al. ACL2017'
  ☆66Updated 3 years ago
• allenai / tpu_pretrain
  LM Pretraining with PyTorch/TPU
  ☆134Updated 5 years ago
• dialogue-evaluation / RuREBus
  RuREBus shared task repo
  ☆30Updated 4 years ago
• mera-company / nlp-embeddings-visualizer
  ☆31Updated 4 years ago
• dsindex / iclassifier
  reference pytorch code for intent classification
  ☆44Updated 5 months ago
• s-nlp / mutual_implication_score
  ☆12Updated 2 years ago
• vklabmipt / implicit-unlikelihood-training
  Improving Neural Text Generation with Reinforcement Learning
  ☆22Updated 4 years ago
• ltgoslo / simple_elmo
  Simple library to work with pre-trained ELMo models in TensorFlow
  ☆52Updated last year
• ispras-texterra / derek
  DEREK (Domain Entities and Relations Extraction Kit)
  ☆10Updated last year
• dayyass / QaNER
  Unofficial implementation of QaNER: Prompting Question Answering Models for Few-shot Named Entity Recognition.
  ☆66Updated 2 years ago
• AranKomat / adapinp
  Unofficial implementation of Adaptive Input in PyTorch
  ☆12Updated 6 years ago
• davidalami / ConveRT
  Dual Encoders for State-of-the-art Natural Language Processing.
  ☆61Updated 2 years ago
• RossiyaSegodnya / ria_news_dataset
  "Rossiya Segodnya" news dataset
  ☆45Updated 5 years ago
• RussianNLP / RuSentEval
  Probing suite for evaluation of Russian embedding and language models
  ☆33Updated 6 months ago
• fursovia / geometric_embedding
  "Zero-Training Sentence Embedding via Orthogonal Basis" paper implementation
  ☆19Updated 6 years ago
• esceptico / squeezer
  Lightweight knowledge distillation pipeline
  ☆28Updated 3 years ago
• snakers4 / cft-contest-2018
  Repository with illustrations for cft-contest-2018
  ☆12Updated 6 years ago
• JulesBelveze / bert-squeeze
  🛠️ Tools for Transformers compression using PyTorch Lightning ⚡
  ☆82Updated 5 months ago
• yang-zhang / lightning-language-modeling
  Language Modeling Example with Transformers and PyTorch Lighting
  ☆65Updated 4 years ago
• UriSha / EmbeddinglessNMT
  The implementation of "Neural Machine Translation without Embeddings", NAACL 2021
  ☆33Updated 3 years ago
• jwieting / paraphrastic-representations-at-scale
  ☆75Updated 3 years ago
• uds-lsv / bert-stable-fine-tuning
  On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines
  ☆136Updated last year