Alternatives and similar repositories for TDS:

Users that are interested in TDS are comparing it to the libraries listed below

• TsinghuaAI / CPM-1-Pretrain
  Pretrain CPM-1
  ☆51Updated 3 years ago
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 3 years ago
• fuzihaofzh / repetition-problem-nlg
  Code for the paper "A Theoretical Analysis of the Repetition Problem in Text Generation" in AAAI 2021.
  ☆52Updated 2 years ago
• QipengGuo / NLP-Notes
  Notes of my introduction about NLP in Fudan University
  ☆37Updated 3 years ago
• GeneZC / MiniMoE
  Code for ACL 2023 paper titled "Lifting the Curse of Capacity Gap in Distilling Language Models"
  ☆28Updated last year
• TsinghuaAI / CUGE
  ☆53Updated 2 years ago
• ProjectD-AI / LLaMA-Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆69Updated last year
• microsoft / BANG
  BANG is a new pretraining model to Bridge the gap between Autoregressive (AR) and Non-autoregressive (NAR) Generation. AR and NAR generat…
  ☆28Updated 3 years ago
• fastnlp / ElasticBERT
  A pre-trained model with multi-exit transformer architecture.
  ☆55Updated 2 years ago
• txsun1997 / nlp-paradigm-shift
  Paradigm shift in natural language processing
  ☆42Updated 2 years ago
• jxhe / efficient-knnlm
  Pytorch implementation of paper "Efficient Nearest Neighbor Language Models" (EMNLP 2021)
  ☆72Updated 3 years ago
• microsoft / SEED-Encoder
  ☆43Updated 3 years ago
• TobiasLee / Awesome-Efficient-PLM
  Must-read papers on improving efficiency for pre-trained language models.
  ☆102Updated 2 years ago
• thunlp / Knowledge-Inheritance
  Source code for paper: Knowledge Inheritance for Pre-trained Language Models
  ☆38Updated 2 years ago
• IBM / PoWER-BERT
  Method to improve inference time for BERT. This is an implementation of the paper titled "PoWER-BERT: Accelerating BERT Inference via Pro…
  ☆60Updated last year
• princeton-nlp / DinkyTrain
  Princeton NLP's pre-training library based on fairseq with DeepSpeed kernel integration 🚃
  ☆114Updated 2 years ago
• dimil6666 / shannon.ai-breaking-news
  香侬科技（北京香侬慧语科技有限责任公司）知乎爆料备份
  ☆41Updated 4 years ago
• keezen / ntk_alibi
  NTK scaled version of ALiBi position encoding in Transformer.
  ☆67Updated last year
• EleutherAI / pile_dedupe
  Pile Deduplication Code
  ☆16Updated last year
• gao-xiao-bai / JsonTuning
  JsonTuning: Towards Generalizable, Robust, and Controllable Instruction Tuning
  ☆10Updated 4 months ago
• allenai / data-efficient-finetuning
  Code for paper 'Data-Efficient FineTuning'
  ☆29Updated last year
• infinigence / LVEval
  Repository of LV-Eval Benchmark
  ☆58Updated 6 months ago
• hpcaitech / ColossalAI-Pytorch-lightning
  ☆24Updated 2 years ago
• RUCAIBox / ELMER
  This repository is the official implementation of our EMNLP 2022 paper ELMER: A Non-Autoregressive Pre-trained Language Model for Efficie…
  ☆26Updated 2 years ago
• BAAI-WuDao / P-tuning
  Finetune CPM-1
  ☆24Updated 3 years ago
• hemingkx / SpecDec
  Codes for our paper "Speculative Decoding: Exploiting Speculative Execution for Accelerating Seq2seq Generation" (EMNLP 2023 Findings)
  ☆39Updated last year
• luciusssss / why-learn-shortcut
  [ACL'21 Findings] Why Machine Reading Comprehension Models Learn Shortcuts?
  ☆16Updated last year
• Shawn-Guo-CN / Lossless_Text_Compression_with_Transformer
  This repo is to demo the concept of lossless compression with Transformers as encoder and decoder.
  ☆14Updated 10 months ago
• lemmonation / fcl-nat
  Code for "Fine-Tuning by Curriculum Learning for Non-Autoregressive Neural Machine Translation"
  ☆13Updated 4 years ago
• BohanLi0110 / NLP-DA-Papers
  ☆22Updated 3 years ago