Alternatives and similar repositories for A-Survey-on-Mixture-of-Experts-in-LLMs:

Users that are interested in A-Survey-on-Mixture-of-Experts-in-LLMs are comparing it to the libraries listed below

• pprp / Awesome-LLM-Prune
  Awesome list for LLM pruning.
  ☆204Updated 2 months ago
• liyunqianggyn / Awesome-LLMs-Pruning
  Awesome LLM pruning papers all-in-one repository with integrating all useful resources and insights.
  ☆72Updated 2 months ago
• UbiquitousLearning / Efficient_Foundation_Model_Survey
  Survey Paper List - Efficient LLM and Foundation Models
  ☆241Updated 5 months ago
• pprp / Awesome-LLM-Quantization
  Awesome list for LLM quantization
  ☆175Updated 2 months ago
• EnnengYang / Awesome-Model-Merging-Methods-Theories-Applications
  Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. arXiv:2408.07666.
  ☆326Updated this week
• October2001 / Awesome-KV-Cache-Compression
  📰 Must-read papers on KV Cache Compression (constantly updating 🤗).
  ☆327Updated this week
• Zefan-Cai / Awesome-LLM-KV-Cache
  Awesome-LLM-KV-Cache: A curated list of 📙Awesome LLM KV Cache Papers with Codes.
  ☆220Updated 2 months ago
• hemingkx / Spec-Bench
  Spec-Bench: A Comprehensive Benchmark and Unified Evaluation Platform for Speculative Decoding (ACL 2024 Findings)
  ☆230Updated this week
• Clin0212 / HydraLoRA
  [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
  ☆165Updated 3 months ago
• lliai / Awesome-LoRA-Low-Rank-Adaptation
  Awesome-Low-Rank-Adaptation
  ☆81Updated 4 months ago
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆90Updated 5 months ago
• RUCAIBox / Slow_Thinking_with_LLMs
  A series of technical report on Slow Thinking with LLM
  ☆438Updated this week
• Chaos96 / fourierft
  ☆142Updated 5 months ago
• swordlidev / Efficient-Multimodal-LLMs-Survey
  Efficient Multimodal Large Language Models: A Survey
  ☆319Updated 6 months ago
• yuandong-tian / arXiv_recbot
  A Telegram bot to recommend arXiv papers
  ☆249Updated 3 weeks ago
• THUDM / ReST-MCTS
  ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search (NeurIPS 2024)
  ☆580Updated last month
• hemingkx / SpeculativeDecodingPapers
  📰 Must-read papers and blogs on Speculative Decoding ⚡️
  ☆609Updated this week
• NVlabs / MaskLLM
  [NeurIPS 24 Spotlight] MaskLLM: Learnable Semi-structured Sparsity for Large Language Models
  ☆152Updated 2 months ago
• YouAreSpecialToMe / QST
  Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models
  ☆42Updated 3 months ago
• dvlab-research / Step-DPO
  Implementation for "Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs"
  ☆350Updated last month
• TUDB-Labs / MixLoRA
  State-of-the-art Parameter-Efficient MoE Fine-tuning Method
  ☆134Updated 6 months ago
• GCYZSL / MoLA
  ☆125Updated 7 months ago
• tiingweii-shii / Awesome-Resource-Efficient-LLM-Papers
  a curated list of high-quality papers on resource-efficient LLMs 🌱
  ☆104Updated last month
• Lucky-Lance / Expert_Sparsity
  [ACL 2024] Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models
  ☆84Updated 9 months ago
• wjn1996 / Awesome-LLM-Reasoning-Openai-o1-Survey
  The related works and background techniques about Openai o1
  ☆215Updated last month
• astramind-ai / Mixture-of-depths
  Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆148Updated 8 months ago
• codecaution / Awesome-Mixture-of-Experts-Papers
  A curated reading list of research in Mixture-of-Experts(MoE).
  ☆590Updated 4 months ago