Alternatives and similar repositories for CPM-1-Pretrain

Users that are interested in CPM-1-Pretrain are comparing it to the libraries listed below

• TsinghuaAI / CPM
  Introduction to CPM
  ☆165Updated 3 years ago
• TsinghuaAI / CUGE
  ☆53Updated 3 years ago
• TsinghuaAI / CPM-2-Finetune
  Finetune CPM-2
  ☆82Updated 2 years ago
• TsinghuaAI / CPM-1-Finetune
  Finetune CPM-1
  ☆74Updated 2 years ago
• ZhuiyiTechnology / roformer-v2
  RoFormer升级版
  ☆153Updated 2 years ago
• ProjectD-AI / LLaMA-Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆69Updated 2 years ago
• THUDM / iPrompt
  Code, Data and Demo for Paper: Controllable Generation from Pre-trained Language Models via Inverse Prompting
  ☆122Updated 2 years ago
• CLUEbenchmark / OCNLI
  OCNLI: 中文原版自然语言推理任务
  ☆157Updated 3 years ago
• JunnYu / FLASHQuad_pytorch
  FLASHQuad_pytorch
  ☆67Updated 3 years ago
• bojone / P-tuning
  P-tuning方法在中文上的简单实验
  ☆139Updated 4 years ago
• TsinghuaAI / TDS
  A plug-in of Microsoft DeepSpeed to fix the bug of DeepSpeed pipeline
  ☆25Updated 4 years ago
• yizhen20133868 / Awesome-TOD-NLG-Survey
  Tracking the progress in NLG for task-oriented dialogue system (resources, code, and new frontiers etc.)
  ☆134Updated 3 years ago
• thu-coai / OPD
  OPD: Chinese Open-Domain Pre-trained Dialogue Model
  ☆75Updated 2 years ago
• Hzfinfdu / PLMTuningCompetition
  擂台赛3-大规模预训练调优比赛的示例代码与baseline实现
  ☆38Updated 2 years ago
• RUCKBReasoning / GLM-Dialog
  ☆59Updated 2 years ago
• keezen / ntk_alibi
  NTK scaled version of ALiBi position encoding in Transformer.
  ☆69Updated last year
• bojone / r-drop
  R-Drop方法在中文任务上的简单实验
  ☆91Updated 3 years ago
• txsun1997 / nlp-paradigm-shift
  Paradigm shift in natural language processing
  ☆42Updated 3 years ago
• Langboat / mengzi-zero-shot
  NLU & NLG (zero-shot) depend on mengzi-t5-base-mt pretrained model
  ☆74Updated 2 years ago
• TobiasLee / Awesome-Efficient-PLM
  Must-read papers on improving efficiency for pre-trained language models.
  ☆104Updated 2 years ago
• jeffchy / RE2RNN
  Source code for the EMNLP 2020 paper "Cold-Start and Interpretability: Turning Regular Expressions intoTrainable Recurrent Neural Network…
  ☆115Updated 3 years ago
• HillZhang1999 / CTC-Report
  CTC2021-中文文本纠错大赛的SOTA方案及在线演示
  ☆72Updated 2 years ago
• xueyouluo / S2S-in-Production
  分享一些S2S在实际应用中遇到的问题和解决方法。
  ☆27Updated 5 years ago
• PANXiao1994 / mRASP2
  ☆120Updated 3 years ago
• TsinghuaAI / CPM-2-Pretrain
  Code for CPM-2 Pre-Train
  ☆158Updated 2 years ago
• wxl1999 / PLMPapers
  A paper list of pre-trained language models (PLMs).
  ☆81Updated 3 years ago
• qhduan / mt5-soft-prompt-tuning
  ☆45Updated 3 years ago
• THUDM / Chinese-Transformer-XL
  ☆218Updated 2 years ago
• wakafengfan / simcse-pytorch
  pytorch版simcse无监督语义相似模型
  ☆22Updated 4 years ago
• BohanLi0110 / NLP-DA-Papers
  ☆23Updated 3 years ago