1140310118 / tdlmLinks
实现了Transformer中的几种位置编码方案
☆44Updated 4 years ago
Alternatives and similar repositories for tdlm
Users that are interested in tdlm are comparing it to the libraries listed below
Sorting:
- FLASHQuad_pytorch☆68Updated 3 years ago
- 基于Gated Attention Unit的Transformer模型(尝鲜版)☆98Updated 2 years ago
- R-Drop方法在中文任务上的简单实验☆91Updated 3 years ago
- Apply the Circular to the Pretraining Model☆38Updated 3 years ago
- SimCSE有监督与无监督实验复现☆149Updated last year
- 论文模型复现☆43Updated 3 years ago
- Implementation of some unbalanced loss like focal_loss, dice_loss, DSC Loss, GHM Loss et.al☆267Updated 2 years ago
- 简洁易用版TinyBert:基于Bert进行知识蒸馏的预训练语言模型☆268Updated 4 years ago
- RoFormer升级版☆154Updated 3 years ago
- ☆44Updated 3 years ago
- RoFormer V1 & V2 pytorch☆512Updated 3 years ago
- 中文数据集下SimCSE+ESimCSE的实现☆193Updated 3 years ago
- Pytorch version of BERT-whitening☆309Updated 4 years ago
- WoBERT_pytorch☆41Updated 4 years ago
- P-tuning方法在中文上的简单实验☆140Updated 4 years ago
- 句子匹配模型,包括无监督的SimCSE、ESimCSE、PromptBERT,和有监督的SBERT、CoSENT。☆100Updated 2 years ago
- Text to text with reinforcement learning☆31Updated 2 years ago
- Official implementation of AAAI-21 paper "Label Confusion Learning to Enhance Text Classification Models"☆118Updated 3 years ago
- 擂台赛3-大规模预训练调优比赛的示例代码与baseline实现☆37Updated 3 years ago
- 从头训练MASK BERT