Distillation of BERT model with catalyst framework
☆78Jun 12, 2023Updated 2 years ago
Alternatives and similar repositories for bert-distillation
Users that are interested in bert-distillation are comparing it to the libraries listed below
Sorting:
- A small library with distillation, quantization and pruning pipelines☆26Apr 20, 2021Updated 4 years ago
- Code for Paper "Target-oriented Fine-tuning for Zero-Resource Named Entity Recognition"☆20Sep 28, 2022Updated 3 years ago
- Code for "Incorporating Relevance Feedback for Information-Seeking Retrieval using Few-Shot Document Re-Ranking" (https://arxiv.org/abs/2…☆14Feb 2, 2026Updated last month
- Russian dialog datasets parsers and crawlers.☆15Sep 6, 2021Updated 4 years ago
- As good as new. How to successfully recycle English GPT-2 to make models for other languages (ACL Findings 2021)☆48Aug 2, 2021Updated 4 years ago
- Simple Questions Generate Named Entity Recognition Datasets (EMNLP 2022)☆76Apr 10, 2023Updated 2 years ago
- Links to Russian corpora + Python functions for loading and parsing☆309Feb 9, 2026Updated 3 weeks ago
- KnowMAN: Weakly Supervised Multinomial Adversarial Networks☆12Nov 9, 2021Updated 4 years ago
- A Python Natural Language Processing Toolkit for Electronic Health Record Texts☆13May 24, 2023Updated 2 years ago
- 🎵 muse: Music Separation☆11Feb 14, 2024Updated 2 years ago
- This repository contains data, code and models for contextual noncompliance.☆25Jul 18, 2024Updated last year
- An experiment to see if chatgpt can improve the output of the stanford alpaca dataset☆12Mar 29, 2023Updated 2 years ago
- Repository with illustrations for cft-contest-2018☆12Nov 22, 2018Updated 7 years ago
- Data and Code for Paper "Reflect Not Reflex: Inference-Based Common Ground Improves Dialogue Response Quality" (EMNLP 2022)☆11Nov 28, 2022Updated 3 years ago
- ☆10Sep 1, 2018Updated 7 years ago
- 🛠️ Tools for Transformers compression using PyTorch Lightning ⚡☆85Feb 1, 2026Updated last month
- Примеры пропозалов для подачи заявки в Open.TLab☆28Dec 15, 2022Updated 3 years ago
- exBERT on Transformers🤗☆10Jun 14, 2021Updated 4 years ago
- Catalyst.Detection☆12Sep 13, 2021Updated 4 years ago
- ☆36Feb 23, 2026Updated last week
- ☆13Nov 19, 2022Updated 3 years ago
- Deep Learning with Catalyst☆300Sep 28, 2021Updated 4 years ago
- Prune a model while finetuning or training.☆406Jun 21, 2022Updated 3 years ago
- PathPiece tokenizer☆13Nov 10, 2024Updated last year
- CraftML is a restful web service for easy pipeline creation without code.☆13Apr 18, 2021Updated 4 years ago
- ☆16May 14, 2024Updated last year
- ☆92Sep 29, 2021Updated 4 years ago
- Alternate Implementation for Zero Shot Text Classification: Instead of reframing NLI/XNLI, this reframes the text backbone of CLIP models…☆37Apr 5, 2022Updated 3 years ago
- SentAugment is a data augmentation technique for NLP that retrieves similar sentences from a large bank of sentences. It can be used in c…☆359Feb 22, 2022Updated 4 years ago
- This repository contains the code for "Generating Datasets with Pretrained Language Models".☆189Aug 17, 2021Updated 4 years ago
- A Pytorch version of LPCNet, including dump weight☆36May 5, 2022Updated 3 years ago
- Code for unsupervised aspect extraction, using Keras and its Backends☆91Jul 6, 2023Updated 2 years ago
- Implementation of AutoSVD++ (SIGIR 2017)☆15Aug 10, 2018Updated 7 years ago
- Attribute statements generated by LLMs to preceding tokens using attention weights.☆22Apr 22, 2025Updated 10 months ago
- ☆24Jan 18, 2021Updated 5 years ago
- N/A☆18Aug 15, 2022Updated 3 years ago
- LV-BERT: Exploiting Layer Variety for BERT (Findings of ACL 2021)☆18May 10, 2023Updated 2 years ago
- A PyTorch Implementation of PlaNet: A Deep Planning Network for Reinforcement Learning☆12Aug 31, 2020Updated 5 years ago
- Code release for "TempLM: Distilling Language Models into Template-Based Generators"☆14Jul 21, 2022Updated 3 years ago