A PyTorch-based model pruning toolkit for pre-trained language models
☆388Aug 31, 2023Updated 2 years ago
Alternatives and similar repositories for TextPruner
Users that are interested in TextPruner are comparing it to the libraries listed below
Sorting:
- A PyTorch-based knowledge distillation toolkit for natural language processing☆1,696May 8, 2023Updated 2 years ago
- GRAIN: Gradient-based Intra-attention Pruning on Pre-trained Language Models☆19Jul 12, 2023Updated 2 years ago
- ☆313Apr 6, 2023Updated 2 years ago
- Revisiting Pre-trained Models for Chinese Natural Language Processing (MacBERT)☆700Jul 15, 2025Updated 7 months ago
- 🛠️ Tools for Transformers compression using PyTorch Lightning ⚡☆85Feb 1, 2026Updated last month
- [ACL 2022] Structured Pruning Learns Compact and Accurate Models https://arxiv.org/abs/2204.00408☆198May 9, 2023Updated 2 years ago
- PERT: Pre-training BERT with Permuted Language Model☆367Jul 15, 2025Updated 7 months ago
- The score code of FastBERT (ACL2020)☆609Oct 29, 2021Updated 4 years ago
- An efficient implementation of the popular sequence models for text generation, summarization, and translation tasks. https://arxiv.org/p…☆433Aug 17, 2022Updated 3 years ago
- Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）☆1,440Jul 15, 2025Updated 7 months ago
- LightSeq: A High Performance Library for Sequence Processing and Generation☆3,303May 16, 2023Updated 2 years ago
- Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo☆3,106May 9, 2024Updated last year
- [EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821☆3,641Oct 16, 2024Updated last year
- a baseline to practice☆45Jul 6, 2021Updated 4 years ago
- Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.☆3,156Jan 22, 2024Updated 2 years ago
- 一键中文数据增强包 ； NLP数据增强、bert数据增强、EDA：pip install nlpcda☆1,879Mar 18, 2025Updated 11 months ago
- ICML'2022: NLP From Scratch Without Large-Scale Pretraining: A Simple and Efficient Framework☆253Jan 7, 2024Updated 2 years ago
- Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）☆10,175Jul 15, 2025Updated 7 months ago
- LERT: A Linguistically-motivated Pre-trained Language Model（语言学信息增强的预训练模型LERT）☆222Jul 15, 2025Updated 7 months ago
- Pre-Trained Chinese XLNet（中文XLNet预训练模型）☆1,650Jul 15, 2025Updated 7 months ago
- a bert for retrieval and generation☆860Feb 26, 2021Updated 5 years ago
- Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀☆1,687Oct 23, 2024Updated last year
- ACL22 paper: Imputing Out-of-Vocabulary Embeddings with LOVE Makes Language Models Robust with Little Cost☆42Nov 15, 2023Updated 2 years ago
- A Large-scale Chinese Short-Text Conversation Dataset and Chinese pre-training dialog models☆1,934Jun 12, 2023Updated 2 years ago
- 高质量中文预训练模型集合：最先 进大模型、最快小模型、相似度专门模型☆816Jul 8, 2020Updated 5 years ago
- BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）☆8,281Oct 16, 2024Updated last year
- ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.☆589Apr 24, 2023Updated 2 years ago
- [NeurIPS 2022] A Fast Post-Training Pruning Framework for Transformers☆192Feb 28, 2023Updated 3 years ago
- RoFormer升级版☆154Aug 11, 2022Updated 3 years ago
- We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tunin…☆2,798Dec 12, 2023Updated 2 years ago
- Data augmentation for NLP☆4,645Jun 24, 2024Updated last year
- Open Language Pre-trained Model Zoo☆1,003Nov 18, 2021Updated 4 years ago
- ☆880May 24, 2024Updated last year
- An Open-Source Framework for Prompt-Learning.☆4,828Jul 16, 2024Updated last year
- Transformer related optimization, including BERT, GPT☆6,394Mar 27, 2024Updated last year
- SimCSE在中文任务上的简单实验☆606Aug 7, 2023Updated 2 years ago
- Code for the RecAdam paper: Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgetting.☆120Nov 10, 2020Updated 5 years ago
- ☆16Dec 14, 2022Updated 3 years ago
- ExpMRC: Explainability Evaluation for Machine Reading Comprehension☆62Aug 30, 2023Updated 2 years ago