Alternatives and similar repositories for Xcompression:

Users that are interested in Xcompression are comparing it to the libraries listed below

• VITA-Group / EarlyBERT
  [ACL-IJCNLP 2021] "EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets" by Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, …
  ☆17Updated 3 years ago
• RunxinXu / ContrastivePruning
  Source code for our AAAI'22 paper 《From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression》
  ☆23Updated 3 years ago
• Alibaba-NLP / MuVER
  [EMNLP 2021] MuVER: Improving First-Stage Entity Retrieval with Multi-View Entity Representations
  ☆30Updated 2 years ago
• thunlp / Seq2Seq-Prompt
  Source code for COLING 2022 paper "Automatic Label Sequence Generation for Prompting Sequence-to-sequence Models"
  ☆24Updated 2 years ago
• jungokasai / T2R
  ☆13Updated 2 years ago
• RUCAIBox / ELMER
  This repository is the official implementation of our EMNLP 2022 paper ELMER: A Non-Autoregressive Pre-trained Language Model for Efficie…
  ☆27Updated 2 years ago
• haorannlp / mix
  Code for "Mixed Cross Entropy Loss for Neural Machine Translation"
  ☆20Updated 3 years ago
• GeneZC / MiniMoE
  Code for ACL 2023 paper titled "Lifting the Curse of Capacity Gap in Distilling Language Models"
  ☆28Updated last year
• lipiji / uChecker
  Code of the COLING22 paper "uChecker: Masked Pretrained Language Models as Unsupervised Chinese Spelling Checkers"
  ☆19Updated 2 years ago
• intersun / CoDIR
  Code for EMNLP 2020 paper CoDIR
  ☆41Updated 2 years ago
• renll / SparseLT
  [EMNLP 2022] Language Model Pre-Training with Sparse Latent Typing
  ☆15Updated last year
• sanagno / adaptively_sparse_attention
  ☆18Updated last year
• bigganbing / Fairseq_MorphTE
  [NeurIPS 2022]MorphTE: Injecting Morphology in Tensorized Embeddings
  ☆17Updated 2 years ago
• thunlp / Knowledge-Inheritance
  Source code for paper: Knowledge Inheritance for Pre-trained Language Models
  ☆38Updated 2 years ago
• fuzihaofzh / repetition-problem-nlg
  Code for the paper "A Theoretical Analysis of the Repetition Problem in Text Generation" in AAAI 2021.
  ☆51Updated 2 years ago
• alibaba / SimCSE-with-CARDS
  Source code for SIGIR 2022 paper.
  ☆15Updated 2 years ago
• Shark-NLP / CAB
  ☆30Updated last year
• ictnlp / Seq-NAT
  Source code for <Sequence-Level Training for Non-Autoregressive Neural Machine Translation>.
  ☆24Updated 3 years ago
• lancopku / MUKI
  [Findings of EMNLP22] From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models
  ☆19Updated last year
• HazyResearch / prefix-linear-attention
  ☆47Updated 6 months ago
• ThomasScialom / T0_continual_learning
  Adding new tasks to T0 without catastrophic forgetting
  ☆32Updated 2 years ago
• lyutyuh / structured-span-selector
  A Structured Span Selector (NAACL 2022). A structured span selector with a WCFG for span selection tasks (coreference resolution, semanti…
  ☆21Updated 2 years ago
• pkuzengqi / Skyformer
  Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)
  ☆60Updated 2 years ago
• thunlp / TR-BERT
  Source code for NAACL 2021 paper "TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference"
  ☆44Updated 2 years ago
• mlpc-ucsd / BERT_Convolutions
  (ACL-IJCNLP 2021) Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models.
  ☆21Updated 2 years ago
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆48Updated last year
• microsoft / Stochastic-Mixture-of-Experts
  This package implements THOR: Transformer with Stochastic Experts.
  ☆61Updated 3 years ago
• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆40Updated 3 months ago
• xiamengzhou / NLPerf
  Performance Prediction for NLP Tasks
  ☆16Updated 4 years ago
• wuch15 / HiTransformer
  ACL 2021: HiTransformer
  ☆12Updated 3 years ago