Alternatives and similar repositories for EMO

Users that are interested in EMO are comparing it to the libraries listed below

• morningmoni / UniPELT
  Code for paper "UniPELT: A Unified Framework for Parameter-Efficient Language Model Tuning", ACL 2022
  ☆61Updated 3 years ago
• TsinghuaC3I / Intuitive-Fine-Tuning
  [ACL 2025, Main Conference, Oral] Intuitive Fine-Tuning: Towards Simplifying Alignment into a Single Process
  ☆28Updated 10 months ago
• cmnfriend / O-LoRA
  ☆175Updated 11 months ago
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆52Updated 2 years ago
• ChaosCodes / ProPETL
  One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning
  ☆39Updated last year
• GCYZSL / MoLA
  ☆142Updated 11 months ago
• shaochenze / PatchTrain
  Code for paper "Patch-Level Training for Large Language Models"
  ☆85Updated 7 months ago
• thu-coai / TaiLr
  ICLR2023 - Tailoring Language Generation Models under Total Variation Distance
  ☆21Updated 2 years ago
• DAMO-NLP-SG / CLEX
  [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models
  ☆78Updated last year
• thunlp / MoEfication
  ☆137Updated 11 months ago
• TsinghuaC3I / SoRA
  [EMNLP 2023, Main Conference] Sparse Low-rank Adaptation of Pre-trained Language Models
  ☆78Updated last year
• Outsider565 / LoRA-GA
  ☆201Updated 8 months ago
• OpenMOSS / Say-I-Dont-Know
  [ICML'2024] Can AI Assistants Know What They Don't Know?
  ☆81Updated last year
• xinghaow99 / DenoSent
  [AAAI 2024] DenoSent: A Denoising Objective for Self-Supervised Sentence Representation Learning
  ☆16Updated last year
• October2001 / ProLong
  [ACL 2024 (Oral)] A Prospector of Long-Dependency Data for Large Language Models
  ☆55Updated 11 months ago
• ChasonShi / MELoRA
  code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"
  ☆19Updated 4 months ago
• yegcjs / DINOISER
  ☆25Updated 2 years ago
• Yuanhy1997 / SeqDiffuSeq
  Text Diffusion Model with Encoder-Decoder Transformers for Sequence-to-Sequence Generation [NAACL 2024]
  ☆96Updated last year
• IndexFziQ / Diffusion4NLP-Papers
  A paper list about diffusion models for natural language processing.
  ☆182Updated last year
• liuqidong07 / MOELoRA-peft
  [SIGIR'24] The official implementation code of MOELoRA.
  ☆168Updated 11 months ago
• Bumble666 / Hyper_MoE
  ☆29Updated 5 months ago
• yikangshen / MoA
  Mixture of Attention Heads
  ☆47Updated 2 years ago
• xhan77 / ssd-lm
  Semi-autoregressive Simplex-based Diffusion Language Model for Text Generation and Modular Control
  ☆70Updated 2 years ago
• nengwp / Lion-vs-Adam
  Lion and Adam optimization comparison
  ☆61Updated 2 years ago
• yegcjs / mixinglaws
  ☆101Updated 8 months ago
• lancopku / label-words-are-anchors
  Repository for Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning
  ☆164Updated last year
• ZhuiyiTechnology / GAU-alpha
  基于Gated Attention Unit的Transformer模型（尝鲜版）
  ☆98Updated 2 years ago
• cofe-ai / Mu-scaling
  Research without Re-search: Maximal Update Parametrization Yields Accurate Loss Prediction across Scales
  ☆32Updated last year
• Hunter-DDM / stablemoe
  Code for the ACL-2022 paper "StableMoE: Stable Routing Strategy for Mixture of Experts"
  ☆47Updated 2 years ago
• BaohaoLiao / mefts
  [NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning
  ☆31Updated 2 years ago