xiongma/roberta-wwm-base-distill external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

xiongma/roberta-wwm-base-distill

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/xiongma/roberta-wwm-base-distill)

Close

xiongma / roberta-wwm-base-distillView on GitHubMore

• External links
• Readme badge

this is roberta wwm base distilled model which was distilled from roberta wwm by roberta wwm large

☆67Mar 30, 2020Updated 6 years ago

Alternatives and similar repositories for roberta-wwm-base-distill

Users that are interested in roberta-wwm-base-distill are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• saurabhkulkarni77 / DistillBERT

  View on GitHub
  ☆61Nov 14, 2019Updated 6 years ago
• CLUEbenchmark / LGEB

  View on GitHub
  LGEB: Benchmark of Language Generation Evaluation
  ☆16Oct 21, 2022Updated 4 years ago
• CLUEbenchmark / DistilBert

  View on GitHub
  DistilBERT for Chinese 海量中文预训练蒸馏bert模型
  ☆95Dec 5, 2019Updated 6 years ago
• qiangsiwei / bert_distill

  View on GitHub
  BERT distillation（基于BERT的蒸馏实验 ）
  ☆317Jul 30, 2020Updated 6 years ago
• noobiegz / cw2vec

  View on GitHub
  Implementation of the cw2vec model
  ☆29Jul 20, 2018Updated 8 years ago
• GPU virtual machines on DigitalOcean Gradient AI • Ad
  Get to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
• brightmart / roberta_zh

  View on GitHub
  RoBERTa中文预训练模型: RoBERTa for Chinese
  ☆2,799Jul 22, 2024Updated 2 years ago
• ZhuiyiTechnology / pretrained-models

  View on GitHub
  Open Language Pre-trained Model Zoo
  ☆1,002Nov 18, 2021Updated 4 years ago
• CLUEbenchmark / ELECTRA

  View on GitHub
  中文 预训练 ELECTRA 模型: 基于对抗学习 pretrain Chinese Model
  ☆141Mar 22, 2020Updated 6 years ago
• momo-journey / mbart-chinese

  View on GitHub
  多语言降噪预训练模型MBart的中文生成任务
  ☆11May 27, 2021Updated 5 years ago
• DukeEnglish / knlp

  View on GitHub
  非常好用的工具包，可以直接安装并使用
  ☆21Mar 18, 2022Updated 4 years ago
• DataTerminatorX / Keyword-BERT

  View on GitHub
  ☆277Dec 8, 2020Updated 5 years ago
• StonyBrookNLP / deformer

  View on GitHub
  [ACL 2020] DeFormer: Decomposing Pre-trained Transformers for Faster Question Answering
  ☆120May 22, 2023Updated 3 years ago
• CLUEbenchmark / PyCLUE

  View on GitHub
  Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark
  ☆134May 22, 2023Updated 3 years ago
• BitVoyage / FastBERT

  View on GitHub
  对ACL2020 FastBERT论文的复现，论文地址//arxiv.org/pdf/2004.02178.pdf
  ☆192Dec 15, 2021Updated 4 years ago
• Proton VPN Special Offer - Get 70% off • Ad
  Special partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
• kevinmtian / distill-bert

  View on GitHub
  Knowledge Distillation from BERT
  ☆54Jan 7, 2019Updated 7 years ago
• KaiQiangSong / joint_parse_summ

  View on GitHub
  (AAAI'20) The source code for the paper "Joint Parsing and Generation for Abstractive Summarization".
  ☆24Apr 22, 2020Updated 6 years ago
• brightmart / xlnet_zh

  View on GitHub
  中文预训练XLNet模型: Pre-Trained Chinese XLNet_Large
  ☆228Sep 13, 2019Updated 7 years ago
• airaria / TextBrewer

  View on GitHub
  A PyTorch-based knowledge distillation toolkit for natural language processing
  ☆1,711May 8, 2023Updated 3 years ago
• haoyuhu / bert-multi-gpu

  View on GitHub
  Feel free to fine tune large BERT models with Multi-GPU and FP16 support.
  ☆193Mar 9, 2020Updated 6 years ago
• wipen / bert_and_ernie

  View on GitHub
  TensorFlow code and pre-trained models for BERT and ERNIE
  ☆147Jun 5, 2019Updated 7 years ago
• yym6472 / ConSERT

  View on GitHub
  Code for our ACL 2021 paper - ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer
  ☆540Dec 10, 2021Updated 4 years ago
• ewrfcas / bert_cn_finetune

  View on GitHub
  Bert finetune for CMRC2018, CJRC, DRCD, CHID, C3
  ☆183Jun 4, 2020Updated 6 years ago
• CLUEbenchmark / CLUEPretrainedModels

  View on GitHub
  高质量中文预训练模型集合：最先进大模型、最快小模型、相似度专门模型
  ☆810Jul 8, 2020Updated 6 years ago
• Managed hosting for WordPress and PHP on Cloudways • Ad
  Managed hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
• bojone / chinese_chatbot_corpus

  View on GitHub
  中文公开聊天语料库
  ☆11Nov 5, 2018Updated 8 years ago
• huawei-noah / Pretrained-Language-Model

  View on GitHub
  Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
  ☆3,171Jan 22, 2024Updated 2 years ago
• ChineseGLUE / PyCLUE

  View on GitHub
  Python toolkit for Chinese Language Understanding Evaluation benchmark.
  ☆15May 22, 2023Updated 3 years ago
• brightmart / albert_zh

  View on GitHub
  A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型
  ☆3,987Nov 21, 2022Updated 3 years ago
• wyu-du / MatchPyramid-for-semantic-matching

  View on GitHub
  A simple Keras implementation of Paper "Text Matching as Image Recognition"
  ☆27Jun 28, 2023Updated 3 years ago
• MatthewZhuang / word2vec-Finance

  View on GitHub
  基于20W金融资讯训练得到的词向量
  ☆27Jan 19, 2018Updated 8 years ago
• shuohangwang / Cross-Thought

  View on GitHub
  ☆47Jan 21, 2021Updated 5 years ago
• AngusMonroe / BLSTM-CRF-NER

  View on GitHub
  BiLSTM+CNN+CRF NER, using pytorch
  ☆15May 26, 2019Updated 7 years ago
• ecchochan / roberta-squad

  View on GitHub
  roBERTa training for SQuAD
  ☆49Mar 2, 2020Updated 6 years ago
• Managed Kubernetes at scale on DigitalOcean • Ad
  DigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
• lonePatient / daguan_2019_rank9

  View on GitHub
  datagrand 2019 information extraction competition rank9
  ☆129Dec 29, 2019Updated 6 years ago
• liu-nlper / dialogue-utterance-rewriter

  View on GitHub
  ACL 2019论文复现：Improving Multi-turn Dialogue Modelling with Utterance ReWriter
  ☆139Jan 23, 2020Updated 6 years ago
• JianGuanTHU / CommonsenseStoryGen

  View on GitHub
  Implementation for paper "A Knowledge-Enhanced Pretraining Model for Commonsense Story Generation"
  ☆24Mar 1, 2020Updated 6 years ago
• sfzhou5678 / PretrainedLittleBERTs

  View on GitHub
  24*2个预训练的小型BERT模型，NLPer炼丹利器
  ☆51Apr 12, 2020Updated 6 years ago
• pengming617 / bert_textMatching

  View on GitHub
  利用预训练的中文模型实现基于bert的语义匹配模型 数据集为LCQMC官方数据
  ☆196Dec 19, 2019Updated 6 years ago
• cdathuraliya / bert-inference

  View on GitHub
  An attempt to make Google BERT closer to production before Hugging Face Transformers etc.
  ☆28Sep 10, 2020Updated 6 years ago
• KuaiSearchPERKS / PERKS

  View on GitHub
  KuaiSearch PERKS
  ☆12Nov 16, 2021Updated 4 years ago