Alternatives and similar repositories for UbiMoE

Users that are interested in UbiMoE are comparing it to the libraries listed below

• Adaxry / Unified_Layer_Skipping
  ☆14Updated last year
• wln20 / CSKV
  [NeurIPS ENLSP Workshop'24] CSKV: Training-Efficient Channel Shrinking for KV Cache in Long-Context Scenarios
  ☆16Updated last year
• dongwonjo / FastKV
  Official Implementation of FastKV: KV Cache Compression for Fast Long-Context Processing with Token-Selective Propagation
  ☆24Updated 5 months ago
• UtkarshSaxena1 / EigenAttn
  ☆16Updated last year
• UNITES-Lab / C2R-MoE
  [NAACL'25 🏆 SAC Award] Official code for "Advancing MoE Efficiency: A Collaboration-Constrained Routing (C2R) Strategy for Better Expert…
  ☆10Updated 8 months ago
• PingchengDong / GQA-LUT
  The official implementation of the DAC 2024 paper GQA-LUT
  ☆20Updated 9 months ago
• jiwonsong-dev / ReasoningPathCompression
  Official implementation of "Reasoning Path Compression: Compressing Generation Trajectories for Efficient LLM Reasoning"
  ☆22Updated 4 months ago
• Mind4Compiler / Compiler-R1
  Compiler-R1: Towards Agentic Compiler Auto-tuning with Reinforcement Learning
  ☆17Updated 3 months ago
• LLMSQL / llmsql-benchmark
  A Text2SQL benchmark for evaluation of Large Language Models
  ☆36Updated this week
• ASISys / AdaSkip
  AdaSkip: Adaptive Sublayer Skipping for Accelerating Long-Context LLM Inference
  ☆15Updated 8 months ago
• GATECH-EIC / Linearized-LLM
  [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models
  ☆35Updated last year
• ArminAzizi98 / LaMDA
  ☆14Updated 11 months ago
• thunlp / SparsingLaw
  The open-source materials for paper "Sparsing Law: Towards Large Language Models with Greater Activation Sparsity".
  ☆26Updated 11 months ago
• Linking-ai / SCOPE
  (ACL 2025 oral) SCOPE: Optimizing KV Cache Compression in Long-context Generation
  ☆33Updated 4 months ago
• CASE-Lab-UMD / Router-Tuning-Mixture-of-Depths
  The open-source Mixture of Depths code and the official implementation of the paper "Router-Tuning: A Simple and Effective Approach for E…
  ☆16Updated 2 weeks ago
• SqueezeAILab / SqueezedAttention
  [ACL 2025] Squeezed Attention: Accelerating Long Prompt LLM Inference
  ☆54Updated 10 months ago
• Lucky-Lance / SPP
  [ICML 2024] SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models
  ☆21Updated last year
• AkideLiu / MiniCache
  ☆10Updated last year
• aiha-lab / MX-QLLM
  LLM Inference with Microscaling Format
  ☆31Updated 11 months ago
• LCM-Lab / LOOM-Eval
  A comprehensive and efficient long-context model evaluation framework
  ☆26Updated last week
• LLMkvsys / rethink-kv-compression
  ☆18Updated 7 months ago
• thu-nics / MBQ
  The code repository of "MBQ: Modality-Balanced Quantization for Large Vision-Language Models"
  ☆64Updated 7 months ago
• metacarbon / shareAtt
  Beyond KV Caching: Shared Attention for Efficient LLMs
  ☆19Updated last year
• Jikai0Wang / OPT-Tree
  ☆29Updated 4 months ago
• gccnlp / Light-PEFT
  [ACL 2024 Findings] Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early Pruning
  ☆13Updated last year
• abdelfattah-lab / xKV
  xKV: Cross-Layer SVD for KV-Cache Compression
  ☆42Updated 3 weeks ago
• DerrickYLJ / TidalDecode
  [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention
  ☆48Updated 2 months ago
• BaohaoLiao / ApiQ
  [EMNLP 2024] Quantize LLM to extremely low-bit, and finetune the quantized LLMs
  ☆14Updated last year
• inclusionAI / MoBE
  Mixture-of-Basis-Experts for Compressing MoE-based LLMs
  ☆18Updated last month
• JarvisPei / CMoE
  Implementation for the paper: CMoE: Fast Carving of Mixture-of-Experts for Efficient LLM Inference
  ☆25Updated 7 months ago