Alternatives and similar repositories for A-Survey-on-Mixture-of-Experts-in-LLMs:

Users that are interested in A-Survey-on-Mixture-of-Experts-in-LLMs are comparing it to the libraries listed below

• hemingkx / Awesome-Efficient-Reasoning
  Paper list for Efficient Reasoning.
  ☆362Updated this week
• Eclipsess / Awesome-Efficient-Reasoning-LLMs
  A Survey on Efficient Reasoning for LLMs
  ☆281Updated this week
• pprp / Awesome-LLM-Prune
  Awesome list for LLM pruning.
  ☆218Updated 3 months ago
• October2001 / Awesome-KV-Cache-Compression
  📰 Must-read papers on KV Cache Compression (constantly updating 🤗).
  ☆367Updated last week
• UbiquitousLearning / Efficient_Foundation_Model_Survey
  Survey Paper List - Efficient LLM and Foundation Models
  ☆241Updated 6 months ago
• liyunqianggyn / Awesome-LLMs-Pruning
  Awesome LLM pruning papers all-in-one repository with integrating all useful resources and insights.
  ☆79Updated 4 months ago
• pprp / Awesome-LLM-Quantization
  Awesome list for LLM quantization
  ☆195Updated 3 months ago
• ThreeSR / Awesome-Inference-Time-Scaling
  Paper List of Inference/Test Time Scaling/Computing
  ☆160Updated this week
• XiaoYee / Awesome_Efficient_LRM_Reasoning
  😎 A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, and Beyond
  ☆152Updated this week
• hemingkx / Spec-Bench
  Spec-Bench: A Comprehensive Benchmark and Unified Evaluation Platform for Speculative Decoding (ACL 2024 Findings)
  ☆247Updated 2 weeks ago
• zepingyu0512 / awesome-llm-understanding-mechanism
  awesome papers in LLM interpretability
  ☆436Updated 2 months ago
• Zefan-Cai / Awesome-LLM-KV-Cache
  Awesome-LLM-KV-Cache: A curated list of 📙Awesome LLM KV Cache Papers with Codes.
  ☆266Updated last month
• NiuTrans / ABigSurveyOfLLMs
  A collection of 150+ surveys on LLMs
  ☆285Updated last month
• Clin0212 / HydraLoRA
  [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
  ☆184Updated 4 months ago
• XueFuzhao / awesome-mixture-of-experts
  A collection of AWESOME things about mixture-of-experts
  ☆1,081Updated 4 months ago
• ZO-Bench / ZO-LLM
  [ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".
  ☆96Updated 9 months ago
• hemingkx / SpeculativeDecodingPapers
  📰 Must-read papers and blogs on Speculative Decoding ⚡️
  ☆672Updated last week
• NVlabs / MaskLLM
  [NeurIPS 24 Spotlight] MaskLLM: Learnable Semi-structured Sparsity for Large Language Models
  ☆160Updated 3 months ago
• Outsider565 / LoRA-GA
  ☆187Updated 5 months ago
• swordlidev / Efficient-Multimodal-LLMs-Survey
  Efficient Multimodal Large Language Models: A Survey
  ☆331Updated last month
• Ablustrund / LoRAMoE
  LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment
  ☆315Updated 11 months ago
• TUDB-Labs / MixLoRA
  State-of-the-art Parameter-Efficient MoE Fine-tuning Method
  ☆153Updated 7 months ago
• bruno686 / Awesome-RL-based-LLM-Reasoning
  Awesome RL-based LLM Reasoning
  ☆406Updated this week
• yuandong-tian / arXiv_recbot
  A Telegram bot to recommend arXiv papers
  ☆264Updated 2 months ago
• codecaution / Awesome-Mixture-of-Experts-Papers
  A curated reading list of research in Mixture-of-Experts(MoE).
  ☆609Updated 5 months ago
• EnnengYang / Awesome-Model-Merging-Methods-Theories-Applications
  Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. arXiv:2408.07666.
  ☆353Updated this week
• fxmeng / TransMLA
  TransMLA: Multi-Head Latent Attention Is All You Need
  ☆226Updated last month
• FairyFali / SLMs-Survey
  Survey of Small Language Models from Penn State, ...
  ☆170Updated 2 months ago
• Wang-ML-Lab / llm-continual-learning-survey
  Continual Learning of Large Language Models: A Comprehensive Survey
  ☆381Updated last month
• astramind-ai / Mixture-of-depths
  Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆156Updated 9 months ago