JunnYu / RoFormer_pytorchLinks
RoFormer V1 & V2 pytorch
☆514Updated 3 years ago
Alternatives and similar repositories for RoFormer_pytorch
Users that are interested in RoFormer_pytorch are comparing it to the libraries listed below
Sorting:
- Rotary Transformer☆1,039Updated 3 years ago
- ☆883Updated last year
- CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation☆492Updated 2 years ago
- Pytorch version of BERT-whitening☆309Updated 4 years ago
- RoFormer升级版☆154Updated 3 years ago
- 简洁易用版TinyBert:基于Bert进行知识蒸馏的预训练语言模型☆268Updated 5 years ago
- 超轻量级bert的pytorch版本,大量中文注释,容易修改结构,持续更新☆418Updated 3 years ago
- Code for our ACL 2021 paper - ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer☆543Updated 3 years ago
- 简单的向量白化改善句向量质量☆488Updated 4 years ago
- 基于Gated Attention Unit的Transformer模型(尝鲜版)☆98Updated 2 years ago
- 更纯粹、更高压缩率的Tokenizer☆485Updated 10 months ago
- SimCSE在中文任务上的简单实验☆605Updated 2 years ago
- ☆419Updated last year
- Mengzi Pretrained Models☆538Updated 2 years ago
- SimCSE有监督与无监督实验复现☆149Updated last year
- A curated list of research papers in Sentence Reprsentation Learning and a sts leaderboard of sentence embeddings.☆315Updated 2 years ago
- Implementation of some unbalanced loss like focal_loss, dice_loss, DSC Loss, GHM Loss et.al☆267Updated 2 years ago
- Code for ACL 2021 paper "ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information"☆563Updated 2 years ago
- SimBERT升级版(SimBERTv2)!☆445Updated 3 years ago
- FewCLUE 小样本学习测评基准,中文版☆515Updated 3 years ago
- pytorch中文语言模型预训练☆388Updated 5 years ago
- 使用sentencepiece中BPE训练中文词表,并在transformers中进行使用。☆120Updated 2 years ago
- Chinese-Text-Classification Project including bert-classification, textCNN and so on.☆160Updated 3 years ago
- 比Sentence-BERT更有效的句向量方案☆376Updated 2 years ago
- 中文数据集下SimCSE+ESimCSE的实现☆193Updated 3 years ago
- 中文自然语言推理数据集(A large-scale Chinese Nature language inference and Semantic similarity calculation Dataset)☆433Updated 5 years ago
- 以词为基本单位的中文BERT☆472Updated 3 years ago
- CoSENT、STS、SentenceBERT☆171Updated 8 months ago
- A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.☆935Updated 3 years ago
- Revisiting Pre-trained Models for Chinese Natural Language Processing (MacBERT)☆687Updated 3 months ago