airaria / TextPruner
A PyTorch-based model pruning toolkit for pre-trained language models
☆372Updated last year
Related projects ⓘ
Alternatives and complementary repositories for TextPruner
- A framework for cleaning Chinese dialog data☆261Updated 3 years ago
- text embedding☆139Updated last year
- ☆297Updated last year
- Code used for sourcing and cleaning the BigScience ROOTS corpus☆306Updated last year
- PromptBERT: Improving BERT Sentence Embeddings with Prompts☆333Updated 11 months ago
- LERT: A Linguistically-motivated Pre-trained Language Model（语言学信息增强的预训练模型LERT）☆202Updated last year
- 比Sentence-BERT更有效的句向量方案☆359Updated 2 years ago
- train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism☆207Updated last year
- ICML'2022: NLP From Scratch Without Large-Scale Pretraining: A Simple and Efficient Framework☆257Updated 10 months ago
- A unified tokenization tool for Images, Chinese and English.☆150Updated last year
- ☆273Updated 6 months ago
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆69Updated last year
- ParaGen is a PyTorch deep learning framework for parallel sequence generation.☆186Updated 2 years ago
- sentence-transformers to onnx 让sbert模型推理效率更快☆162Updated 2 years ago
- Codebase for RetroMAE and beyond.☆240Updated 5 months ago
- PERT: Pre-training BERT with Permuted Language Model☆354Updated last year
- 中文图书语料MD5链接☆211Updated 9 months ago
- A PyTorch-based knowledge distillation toolkit for natural language processing☆1,601Updated last year
- CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation☆481Updated last year
- 3000000+语义理解与匹配数据集。可用于无监督对比学习、半监督学习等构建中文领域效果最好的预训练模型☆280Updated 2 years ago
- Mengzi Pretrained Models☆534Updated last year
- Pytorch version of BERT-whitening☆310Updated 3 years ago
- A curated list of research papers in Sentence Reprsentation Learning and a sts leaderboard of sentence embeddings.☆302Updated last year
- FewCLUE 小样本学习测评基准，中文版☆495Updated 2 years ago
- [NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation☆466Updated 8 months ago
- 中文 Instruction tuning datasets☆118Updated 7 months ago
- [ACL 2022] Structured Pruning Learns Compact and Accurate Models https://arxiv.org/abs/2204.00408☆192Updated last year
- Implementation of Chinese ChatGPT☆287Updated last year
- NLU & NLG (zero-shot) depend on mengzi-t5-base-mt pretrained model☆75Updated 2 years ago
- Simple implementation of using lora form the peft library to fine-tune the chatglm-6b☆86Updated last year