Alternatives and similar repositories for CPM-2-Pretrain

Users that are interested in CPM-2-Pretrain are comparing it to the libraries listed below

• TsinghuaAI / CPM

  View on GitHub
  Introduction to CPM
  ☆165Sep 26, 2021Updated 4 years ago
• TsinghuaAI / CPM-2-Finetune

  View on GitHub
  Finetune CPM-2
  ☆81Mar 18, 2023Updated 2 years ago
• TsinghuaAI / CPM-1-Generate

  View on GitHub
  Chinese Pre-Trained Language Models (CPM-LM) Version-I
  ☆1,582Mar 18, 2023Updated 2 years ago
• TsinghuaAI / TDS

  View on GitHub
  A plug-in of Microsoft DeepSpeed to fix the bug of DeepSpeed pipeline
  ☆25Apr 16, 2021Updated 4 years ago
• TsinghuaAI / CPM-1-Finetune

  View on GitHub
  Finetune CPM-1
  ☆75Mar 18, 2023Updated 2 years ago
• OpenBMB / BMInf

  View on GitHub
  Efficient Inference for Big Models
  ☆587Jan 24, 2023Updated 3 years ago
• TsinghuaAI / CUGE

  View on GitHub
  ☆54Apr 15, 2022Updated 3 years ago
• yangjianxin1 / CPM

  View on GitHub
  Easy-to-use CPM for Chinese text generation（基于CPM的中文文本生成）
  ☆531Apr 10, 2023Updated 2 years ago
• MichaelZhouwang / VLUE

  View on GitHub
  This repo contains codes and instructions for baselines in the VLUE benchmark.
  ☆41Jul 16, 2022Updated 3 years ago
• Yifan-Gao / open_retrieval_conversational_machine_reading

  View on GitHub
  Open-Retrieval Conversational Machine Reading: A new setting & OR-ShARC dataset
  ☆13Nov 19, 2022Updated 3 years ago
• laekov / fastmoe

  View on GitHub
  A fast MoE impl for PyTorch
  ☆1,831Feb 10, 2025Updated last year
• yxuansu / HCL

  View on GitHub
  [ACL'21] Dialogue Response Selection with Hierarchical Curriculum Learning
  ☆21Nov 15, 2022Updated 3 years ago
• Harry-Chen / InfMoE

  View on GitHub
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41May 31, 2021Updated 4 years ago
• Langboat / Mengzi

  View on GitHub
  Mengzi Pretrained Models
  ☆540Nov 29, 2022Updated 3 years ago
• thu-coai / EVA

  View on GitHub
  EVA: Large-scale Pre-trained Chit-Chat Models
  ☆306Mar 11, 2023Updated 2 years ago
• TsinghuaAI / CPM-KG

  View on GitHub
  ☆50Dec 24, 2020Updated 5 years ago
• thu-coai / CDial-GPT

  View on GitHub
  A Large-scale Chinese Short-Text Conversation Dataset and Chinese pre-training dialog models
  ☆1,933Jun 12, 2023Updated 2 years ago
• BAAI-WuDao / Chinese-Transformer-XL

  View on GitHub
  ☆34Jul 29, 2021Updated 4 years ago
• BAAI-WuDao / P-tuning

  View on GitHub
  Finetune CPM-1
  ☆24Jun 20, 2021Updated 4 years ago
• yzheng51 / 2021-GAIIC-Task3-Preliminary-Share

  View on GitHub
  全球人工智能技术创新大赛-赛道三：小布助手对话短文本语义匹配
  ☆12Apr 5, 2021Updated 4 years ago
• thunlp / Knowledge-Inheritance

  View on GitHub
  Source code for paper: Knowledge Inheritance for Pre-trained Language Models
  ☆38Apr 24, 2022Updated 3 years ago
• CLUEbenchmark / CLUECorpus2020

  View on GitHub
  Large-scale Pre-training Corpus for Chinese 100G 中文预训练语料
  ☆997Feb 6, 2026Updated last week
• yxuansu / SimCTG

  View on GitHub
  [NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation
  ☆475Mar 7, 2024Updated last year
• ZhuiyiTechnology / WoBERT

  View on GitHub
  以词为基本单位的中文BERT
  ☆474Nov 18, 2021Updated 4 years ago
• alibaba / AliceMind

  View on GitHub
  ALIbaba's Collection of Encoder-decoders from MinD (Machine IntelligeNce of Damo) Lab
  ☆2,051Mar 19, 2024Updated last year
• fastnlp / CPT

  View on GitHub
  CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation
  ☆495Dec 30, 2022Updated 3 years ago
• BAAI-WuDao / EVA

  View on GitHub
  ☆25Sep 29, 2021Updated 4 years ago
• vikas95 / AIR-retriever

  View on GitHub
  AIR retriever for Multi-Hop QA (ACL 2020 paper)
  ☆30Jul 18, 2020Updated 5 years ago
• ymcui / Chinese-ELECTRA

  View on GitHub
  Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）
  ☆1,439Jul 15, 2025Updated 7 months ago
• dbiir / UER-py

  View on GitHub
  Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo
  ☆3,106May 9, 2024Updated last year
• abhinavkashyap / dct

  View on GitHub
  Repository for the ACL'22 paper "So Different Yet So Alike! Constrained Unsupervised Text Style Transfer"
  ☆16Jan 19, 2024Updated 2 years ago
• ymcui / Chinese-RC-Datasets

  View on GitHub
  Collections of Chinese reading comprehension datasets
  ☆221Dec 19, 2019Updated 6 years ago
• airaria / TextBrewer

  View on GitHub
  A PyTorch-based knowledge distillation toolkit for natural language processing
  ☆1,698May 8, 2023Updated 2 years ago
• luciusssss / why-learn-shortcut

  View on GitHub
  [ACL'21 Findings] Why Machine Reading Comprehension Models Learn Shortcuts?
  ☆16Aug 8, 2023Updated 2 years ago
• TsinghuaAI / CPM-1-Pretrain

  View on GitHub
  Pretrain CPM-1
  ☆52Apr 20, 2021Updated 4 years ago
• tigerchen52 / Biomedical-Entity-Linking

  View on GitHub
  A Keras implementation of the AAAI21 paper "a lightweight neural model for biomedical entity linking"
  ☆53Jul 24, 2022Updated 3 years ago
• thunlp / OpenMatch

  View on GitHub
  An Open-Source Package for Information Retrieval.
  ☆442Oct 7, 2022Updated 3 years ago
• CLUEbenchmark / CLUE

  View on GitHub
  中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard
  ☆4,230Feb 6, 2026Updated last week
• brightmart / roberta_zh

  View on GitHub
  RoBERTa中文预训练模型: RoBERTa for Chinese
  ☆2,773Jul 22, 2024Updated last year