CLUEbenchmark/DistilBert external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

CLUEbenchmark/DistilBert

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/CLUEbenchmark/DistilBert)

Close

CLUEbenchmark / DistilBertView on GitHubMore

• External links
• Readme badge

DistilBERT for Chinese 海量中文预训练蒸馏bert模型

☆96Dec 5, 2019Updated 6 years ago

Alternatives and similar repositories for DistilBert

Users that are interested in DistilBert are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• saurabhkulkarni77 / DistillBERT

  View on GitHub
  ☆61Nov 14, 2019Updated 6 years ago
• cdathuraliya / bert-inference

  View on GitHub
  An attempt to make Google BERT closer to production before Hugging Face Transformers etc.
  ☆28Sep 10, 2020Updated 5 years ago
• xiongma / roberta-wwm-base-distill

  View on GitHub
  this is roberta wwm base distilled model which was distilled from roberta wwm by roberta wwm large
  ☆67Mar 30, 2020Updated 6 years ago
• CLUEbenchmark / LGEB

  View on GitHub
  LGEB: Benchmark of Language Generation Evaluation
  ☆16Oct 21, 2022Updated 3 years ago
• CLUEbenchmark / ELECTRA

  View on GitHub
  中文 预训练 ELECTRA 模型: 基于对抗学习 pretrain Chinese Model
  ☆141Mar 22, 2020Updated 6 years ago
• Proton VPN Special Offer - Get 70% off • Ad
  Special partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
• qiangsiwei / bert_distill

  View on GitHub
  BERT distillation（基于BERT的蒸馏实验 ）
  ☆316Jul 30, 2020Updated 5 years ago
• brightmart / xlnet_zh

  View on GitHub
  中文预训练XLNet模型: Pre-Trained Chinese XLNet_Large
  ☆229Sep 13, 2019Updated 6 years ago
• lonePatient / CLUE_pytorch

  View on GitHub
  CLUE baseline pytorch CLUE的pytorch版本基线
  ☆75Apr 3, 2020Updated 6 years ago
• ymcui / Chinese-ELECTRA

  View on GitHub
  Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）
  ☆1,440Jul 15, 2025Updated 8 months ago
• CLUEbenchmark / MobileQA

  View on GitHub
  离线端阅读理解应用 QA for mobile, Android & iPhone
  ☆60Oct 6, 2022Updated 3 years ago
• brightmart / albert_zh

  View on GitHub
  A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型
  ☆3,986Nov 21, 2022Updated 3 years ago
• brightmart / roberta_zh

  View on GitHub
  RoBERTa中文预训练模型: RoBERTa for Chinese
  ☆2,782Jul 22, 2024Updated last year
• CLUEbenchmark / PyCLUE

  View on GitHub
  Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark
  ☆133May 22, 2023Updated 2 years ago
• airaria / TextBrewer

  View on GitHub
  A PyTorch-based knowledge distillation toolkit for natural language processing
  ☆1,695May 8, 2023Updated 2 years ago
• 1-Click AI Models by DigitalOcean Gradient • Ad
  Deploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
• kxjl-ai-yeta / openapi_doc

  View on GitHub
  Yeta开放平台文档
  ☆14Mar 11, 2020Updated 6 years ago
• huawei-noah / Pretrained-Language-Model

  View on GitHub
  Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
  ☆3,156Jan 22, 2024Updated 2 years ago
• guoday / CCF-BDCI-Sentiment-Analysis-Baseline

  View on GitHub
  The code for CCF-BDCI-Sentiment-Analysis-Baseline
  ☆430Dec 8, 2022Updated 3 years ago
• CLUEbenchmark / KGQA

  View on GitHub
  Knowledge Graph based Question Answering benchmark.
  ☆10Feb 1, 2020Updated 6 years ago
• autoliuweijie / FastBERT

  View on GitHub
  The score code of FastBERT (ACL2020)
  ☆608Oct 29, 2021Updated 4 years ago
• CLUEbenchmark / CLUEPretrainedModels

  View on GitHub
  高质量中文预训练模型集合：最先进大模型、最快小模型、相似度专门模型
  ☆816Jul 8, 2020Updated 5 years ago
• brightmart / machine_reading_comprehension

  View on GitHub
  machine reading comprehension with deep learning
  ☆19Feb 6, 2018Updated 8 years ago
• ewrfcas / bert_cn_finetune

  View on GitHub
  Bert finetune for CMRC2018, CJRC, DRCD, CHID, C3
  ☆184Jun 4, 2020Updated 5 years ago
• lonePatient / albert_pytorch

  View on GitHub
  A Lite Bert For Self-Supervised Learning Language Representations
  ☆714May 13, 2020Updated 5 years ago
• NordVPN Special Discount Offer • Ad
  Save on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
• brightmart / multi-label_classification

  View on GitHub
  transform multi-label classification as sentence pair task, with more training data and information
  ☆178Dec 13, 2019Updated 6 years ago
• ChineseGLUE / ChineseGLUE

  View on GitHub
  Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard
  ☆1,787Feb 18, 2023Updated 3 years ago
• howl-anderson / MicroWeatherBot_CN

  View on GitHub
  基于 rasa 1.x 版本搭建的中文天气查询 demo | A simple & micro Chinese Weatherbot based on rasa framework
  ☆12Aug 14, 2019Updated 6 years ago
• brightmart / nlu_sim

  View on GitHub
  all kinds of baseline models for sentence similarity 句子对语义相似度模型
  ☆296Jul 5, 2018Updated 7 years ago
• GioGioBond / NBCEonChatGLM6b

  View on GitHub
  (NBCE)Naive Bayes-based Context Extension on ChatGLM-6b
  ☆15Jun 7, 2023Updated 2 years ago
• dbiir / UER-py

  View on GitHub
  Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo
  ☆3,106May 9, 2024Updated last year
• ymcui / Chinese-BERT-wwm

  View on GitHub
  Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）
  ☆10,194Jul 15, 2025Updated 8 months ago
• DataTerminatorX / Keyword-BERT

  View on GitHub
  ☆278Dec 8, 2020Updated 5 years ago
• ymcui / Chinese-XLNet

  View on GitHub
  Pre-Trained Chinese XLNet（中文XLNet预训练模型）
  ☆1,649Jul 15, 2025Updated 8 months ago
• Managed Database hosting by DigitalOcean • Ad
  PostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
• pengshuang / Text-Similarity

  View on GitHub
  Text-Similarity Method in Pytorch
  ☆469Dec 9, 2018Updated 7 years ago
• Wwenhui-03 / 2020_baidu_RE

  View on GitHub
  2020语言与智能技术竞赛：关系抽取任务
  ☆10Mar 19, 2020Updated 6 years ago
• YingZiqiang / LES-MMRC-Summary

  View on GitHub
  科赛网-莱斯杯：全国第二届“军事智能机器阅读”挑战赛 前十团队PPT文档代码总结
  ☆132Feb 5, 2020Updated 6 years ago
• sinovation / ZEN

  View on GitHub
  A BERT-based Chinese Text Encoder Enhanced by N-gram Representations
  ☆644Jul 24, 2022Updated 3 years ago
• ymcui / cmrc2019

  View on GitHub
  A Sentence Cloze Dataset for Chinese Machine Reading Comprehension (CMRC 2019)
  ☆126Oct 24, 2022Updated 3 years ago
• pengming617 / text_matching

  View on GitHub
  文本匹配的相关模型DSSM,ESIM,ABCNN,BIMPM等，数据集为LCQMC官方数据
  ☆471May 8, 2022Updated 3 years ago
• alibaba-edu / simple-effective-text-matching

  View on GitHub
  Source code of the ACL2019 paper "Simple and Effective Text Matching with Richer Alignment Features".
  ☆340Oct 11, 2019Updated 6 years ago