Alternatives and similar repositories for UbiMoE

Users that are interested in UbiMoE are comparing it to the libraries listed below

• Adaxry / Unified_Layer_Skipping
  ☆14Updated last year
• wln20 / CSKV
  [NeurIPS ENLSP Workshop'24] CSKV: Training-Efficient Channel Shrinking for KV Cache in Long-Context Scenarios
  ☆16Updated 9 months ago
• ArminAzizi98 / LaMDA
  ☆15Updated 9 months ago
• Mind4Compiler / Compiler-R1
  Compiler-R1: Towards Agentic Compiler Auto-tuning with Reinforcement Learning
  ☆15Updated last month
• dongwonjo / FastKV
  Official Implementation of FastKV: KV Cache Compression for Fast Long-Context Processing with Token-Selective Propagation
  ☆22Updated 2 months ago
• Anonymous1252022 / Megatron-DeepSpeed
  ☆12Updated 10 months ago
• UtkarshSaxena1 / EigenAttn
  ☆16Updated 10 months ago
• UNITES-Lab / C2R-MoE
  [NAACL 25 SAC Award] Official code for "Advancing MoE Efficiency: A Collaboration-Constrained Routing (C2R) Strategy for Better Expert Pa…
  ☆10Updated 6 months ago
• thunlp / SparsingLaw
  The open-source materials for paper "Sparsing Law: Towards Large Language Models with Greater Activation Sparsity".
  ☆25Updated 9 months ago
• jiwonsong-dev / ReasoningPathCompression
  Official implementation of "Reasoning Path Compression: Compressing Generation Trajectories for Efficient LLM Reasoning"
  ☆22Updated 2 months ago
• Jikai0Wang / OPT-Tree
  ☆25Updated 2 months ago
• SqueezeAILab / SqueezedAttention
  SQUEEZED ATTENTION: Accelerating Long Prompt LLM Inference
  ☆51Updated 8 months ago
• Lucky-Lance / SPP
  [ICML 2024] SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models
  ☆21Updated last year
• LLMkvsys / rethink-kv-compression
  ☆16Updated 5 months ago
• ASISys / AdaSkip
  AdaSkip: Adaptive Sublayer Skipping for Accelerating Long-Context LLM Inference
  ☆14Updated 6 months ago
• abdelfattah-lab / xKV
  xKV: Cross-Layer SVD for KV-Cache Compression
  ☆33Updated last week
• LCM-Lab / LOOM-Scope
  A comprehensive and efficient long-context model evaluation framework
  ☆16Updated 2 weeks ago
• AkideLiu / MiniCache
  ☆10Updated 11 months ago
• Linking-ai / SCOPE
  (ACL 2025 oral) SCOPE: Optimizing KV Cache Compression in Long-context Generation
  ☆32Updated 2 months ago
• fyzhang1 / Oblivionis
  Official Repository for "Oblivionis: A Lightweight Learning and Unlearning Framework for Federated Large Language Models"
  ☆21Updated this week
• CASE-Lab-UMD / Router-Tuning-Mixture-of-Depths
  The open-source Mixture of Depths code and the official implementation of the paper "Router-Tuning: A Simple and Effective Approach for E…
  ☆14Updated 8 months ago
• yangyifei729 / KVSharer
  Source code of paper ''KVSharer: Efficient Inference via Layer-Wise Dissimilar KV Cache Sharing''
  ☆27Updated 9 months ago
• JarvisPei / CMoE
  Implementation for the paper: CMoE: Fast Carving of Mixture-of-Experts for Efficient LLM Inference
  ☆23Updated 5 months ago
• GATECH-EIC / Linearized-LLM
  [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models
  ☆33Updated last year
• aiha-lab / MX-QLLM
  LLM Inference with Microscaling Format
  ☆27Updated 9 months ago
• NJUNLP / PATS
  ☆44Updated 2 months ago
• DerrickYLJ / TidalDecode
  [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention
  ☆44Updated last week
• gccnlp / Light-PEFT
  [ACL 2024 Findings] Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early Pruning
  ☆11Updated 11 months ago
• metacarbon / shareAtt
  Beyond KV Caching: Shared Attention for Efficient LLMs
  ☆19Updated last year
• tongxuluo / prts
  Code and Model for NeurIPS 2024 Spotlight Paper "Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training…
  ☆42Updated 10 months ago