Alternatives and similar repositories for bert-distillation:

Users that are interested in bert-distillation are comparing it to the libraries listed below

• elephantmipt / compressors
  A small library with distillation, quantization and pruning pipelines
  ☆26Updated 3 years ago
• alexeykarnachev / full_stack_transformer
  Pytorch library for end-to-end transformer models training, inference and serving
  ☆70Updated 2 years ago
• Yorko / gender-unbiased_BERT-based_pronoun_resolution
  Source code for the ACL workshop paper and Kaggle competition by Google AI team
  ☆40Updated 3 years ago
• eatsleepraverepeat / reMUDE
  (re)Implementation of Learning Multi-level Dependencies for Robust Word Recognition
  ☆17Updated 7 months ago
• Geotrend-research / smaller-transformers
  Load What You Need: Smaller Multilingual Transformers for Pytorch and TensorFlow 2.0.
  ☆102Updated 2 years ago
• s-nlp / annotated-transformer
  http://nlp.seas.harvard.edu/2018/04/03/attention.html
  ☆63Updated 3 years ago
• allenai / tpu_pretrain
  LM Pretraining with PyTorch/TPU
  ☆134Updated 5 years ago
• vlarine / ruberta
  Russian RoBERTa
  ☆29Updated 5 years ago
• ltgoslo / simple_elmo
  Simple library to work with pre-trained ELMo models in TensorFlow
  ☆52Updated last year
• mera-company / nlp-embeddings-visualizer
  ☆31Updated 4 years ago
• vklabmipt / implicit-unlikelihood-training
  Improving Neural Text Generation with Reinforcement Learning
  ☆21Updated 4 years ago
• ofirpress / sandwich_transformer
  This repository contains the code for running the character-level Sandwich Transformers from our ACL 2020 paper on Improving Transformer …
  ☆55Updated 4 years ago
• ispras-texterra / derek
  DEREK (Domain Entities and Relations Extraction Kit)
  ☆10Updated last year
• uds-lsv / bert-stable-fine-tuning
  On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines
  ☆135Updated last year
• ofirpress / shortformer
  Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.
  ☆146Updated 3 years ago
• AranKomat / adapinp
  Unofficial implementation of Adaptive Input in PyTorch
  ☆12Updated 6 years ago
• fursovia / geometric_embedding
  "Zero-Training Sentence Embedding via Orthogonal Basis" paper implementation
  ☆19Updated 6 years ago
• dayyass / QaNER
  Unofficial implementation of QaNER: Prompting Question Answering Models for Few-shot Named Entity Recognition.
  ☆66Updated 2 years ago
• dsindex / iclassifier
  reference pytorch code for intent classification
  ☆44Updated 5 months ago
• JulesBelveze / bert-squeeze
  🛠️ Tools for Transformers compression using PyTorch Lightning ⚡
  ☆82Updated 4 months ago
• yandex-research / graph-glove
  PyTorch code for the EMNLP 2020 paper "Embedding Words in Non-Vector Space with Unsupervised Graph Learning"
  ☆41Updated 4 years ago
• gsarti / lambda-bert
  A 🤗-style implementation of BERT using lambda layers instead of self-attention
  ☆69Updated 4 years ago
• snakers4 / cft-contest-2018
  Repository with illustrations for cft-contest-2018
  ☆12Updated 6 years ago
• allenai / sledgehammer
  ☆47Updated 4 years ago
• microsoft / xtreme-distil-transformers
  XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale
  ☆153Updated last year
• UriSha / EmbeddinglessNMT
  The implementation of "Neural Machine Translation without Embeddings", NAACL 2021
  ☆33Updated 3 years ago
• davidalami / ConveRT
  Dual Encoders for State-of-the-art Natural Language Processing.
  ☆61Updated 2 years ago
• yang-zhang / lightning-language-modeling
  Language Modeling Example with Transformers and PyTorch Lighting
  ☆65Updated 4 years ago
• AkariAsai / extractive_rc_by_runtime_mt
  Code and datasets of "Multilingual Extractive Reading Comprehension by Runtime Machine Translation"
  ☆40Updated 6 years ago
• alexeyev / abae-pytorch
  PyTorch implementation of 'An Unsupervised Neural Attention Model for Aspect Extraction' by He et al. ACL2017'
  ☆66Updated 3 years ago