Alternatives and similar repositories for UniPELT

Users that are interested in UniPELT are comparing it to the libraries listed below

• jxhe / unify-parameter-efficient-tuning

  View on GitHub
  Implementation of paper "Towards a Unified View of Parameter-Efficient Transfer Learning" (ICLR 2022)
  ☆543Mar 24, 2022Updated 3 years ago
• Allen0307 / AdapterBias

  View on GitHub
  Code for the Findings of NAACL 2022(Long Paper): AdapterBias: Parameter-efficient Token-dependent Representation Shift for Adapters in NL…
  ☆18May 4, 2022Updated 3 years ago
• rabeehk / compacter

  View on GitHub
  ☆130Aug 18, 2022Updated 3 years ago
• cambridgeltl / autopeft

  View on GitHub
  AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning (Zhou et al.; TACL 2024)
  ☆51Mar 17, 2024Updated last year
• cambridgeltl / composable-sft

  View on GitHub
  A library for parameter-efficient and composable transfer learning for NLP with sparse fine-tunings.
  ☆75Aug 9, 2024Updated last year
• zhuyunqi96 / LoraLPrun

  View on GitHub
  ☆13May 21, 2023Updated 2 years ago
• wutong8023 / SpeechRE

  View on GitHub
  ☆11Nov 11, 2022Updated 3 years ago
• microsoft / LiST

  View on GitHub
  Lite Self-Training
  ☆30Jul 25, 2023Updated 2 years ago
• yannikbenz / zeroe

  View on GitHub
  From Hero to Zéroe: A Benchmark of Low-Level Adversarial Attacks
  ☆14Feb 23, 2023Updated 2 years ago
• SALT-NLP / Persuasion_Strategy_WVAE

  View on GitHub
  ☆13Jan 8, 2021Updated 5 years ago
• nchen909 / CodeAttention

  View on GitHub
  CAT-probing: A Metric-based Approach to Interpret How Pre-trained Models for Programming Language Attend Code Structure, EMNLP 2022
  ☆13Dec 10, 2022Updated 3 years ago
• rabeehk / hyperformer

  View on GitHub
  ☆156Aug 24, 2021Updated 4 years ago
• benzakenelad / BitFit

  View on GitHub
  Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models
  ☆143Sep 4, 2022Updated 3 years ago
• AlexYangLi / iswc2020_prodcls

  View on GitHub
  ISWC2020 Semantic Web Challenge - Product Classification Top1 Solution
  ☆15Nov 18, 2020Updated 5 years ago
• jiwei0921 / MVSS-Baseline

  View on GitHub
  Baseline Code for CVPR 2023 paper. "Multispectral Video Semantic Segmentation: A Benchmark Dataset and Baseline".
  ☆14Sep 21, 2023Updated 2 years ago
• dongxinshuai / RIFT-NeurIPS2021

  View on GitHub
  ☆11Mar 6, 2022Updated 3 years ago
• aimagelab / MaPeT

  View on GitHub
  Learning to Mask and Permute Visual Tokens for Vision Transformer Pre-Training
  ☆16Jul 1, 2025Updated 7 months ago
• Abbey4799 / PLMs-Interpret-Simile

  View on GitHub
  Code and datasets for the paper "Can Pre-trained Language Models Interpret Similes as Smart as Human?" (ACL 2022)
  ☆14Jan 4, 2023Updated 3 years ago
• Jiaxin-Pei / Potato-Prolific-Dataset

  View on GitHub
  ☆16Jun 14, 2023Updated 2 years ago
• qcwthu / Lifelong-Fewshot-Language-Learning

  View on GitHub
  The code for lifelong few-shot language learning
  ☆55Feb 17, 2022Updated 4 years ago
• EleutherAGI / summarisation

  View on GitHub
  The Intermediate Goal of the project is to train a GPT like architecture to learn to summarise reddit posts from human preferences, as th…
  ☆12Jul 14, 2021Updated 4 years ago
• zju-SWJ / RLD

  View on GitHub
  Official implementation for "Knowledge Distillation with Refined Logits".
  ☆21Aug 26, 2024Updated last year
• microsoft / Stochastic-Mixture-of-Experts

  View on GitHub
  This package implements THOR: Transformer with Stochastic Experts.
  ☆65Oct 7, 2021Updated 4 years ago
• cambridgeltl / mirror-bert

  View on GitHub
  [EMNLP'21] Mirror-BERT: Converting Pretrained Language Models to universal text encoders without labels.
  ☆77Aug 14, 2022Updated 3 years ago
• mt-upc / iwslt-2021

  View on GitHub
  Systems submitted to IWSLT 2021 by the MT-UPC group.
  ☆14Feb 23, 2023Updated 2 years ago
• momozzing / kiosk_bot

  View on GitHub
  KoGPT-2 finetuning Based Kiosk chatbot
  ☆12Dec 12, 2023Updated 2 years ago
• leezythu / FocusLLM

  View on GitHub
  FocusLLM: Scaling LLM’s Context by Parallel Decoding
  ☆44Dec 8, 2024Updated last year
• zhenwang9102 / coherence-boosting

  View on GitHub
  Coherence boosting: When your pretrained language model is not paying enough attention (ACL 2022) https://arxiv.org/abs/2110.08294
  ☆15Apr 23, 2023Updated 2 years ago
• RUCAIBox / MPOE

  View on GitHub
  ☆19Sep 15, 2022Updated 3 years ago
• NL2Code / CodeM

  View on GitHub
  ☆44Jun 2, 2024Updated last year
• LLMkvsys / rethink-kv-compression

  View on GitHub
  ☆22Mar 7, 2025Updated 11 months ago
• FranxYao / Complexity-Based-Prompting

  View on GitHub
  Complexity Based Prompting for Multi-Step Reasoning
  ☆17Mar 10, 2023Updated 2 years ago
• TeamLab / pdcde2018

  View on GitHub
  Full paper available on Researchgate
  ☆17Oct 21, 2018Updated 7 years ago
• Shwai-He / MEO

  View on GitHub
  The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":
  ☆44Apr 7, 2024Updated last year
• sooftware / luna-transformer

  View on GitHub
  A PyTorch Implementation of the Luna: Linear Unified Nested Attention
  ☆41Jul 29, 2021Updated 4 years ago
• wzhuang-xmu / LoSA

  View on GitHub
  [ICLR 2025] Official implementation of paper "Dynamic Low-Rank Sparse Adaptation for Large Language Models".
  ☆23Mar 16, 2025Updated 11 months ago
• rsvp-ai / segatron_aaai

  View on GitHub
  codes and pre-trained models of paper "Segatron: Segment-aware Transformer for Language Modeling and Understanding"
  ☆18Oct 25, 2022Updated 3 years ago
• yikangshen / MoA

  View on GitHub
  Mixture of Attention Heads
  ☆51Oct 10, 2022Updated 3 years ago
• chenchongyuan / 2019BDC

  View on GitHub
  2019中国高校计算机大赛——大数据挑战赛 第一名解决方案
  ☆42Oct 8, 2020Updated 5 years ago