Alternatives and similar repositories for mdy_triton:

Users that are interested in mdy_triton are comparing it to the libraries listed below

• BaiTheBest / SparseLLM
  Official Repo for SparseLLM: Global Pruning of LLMs (NeurIPS 2024)
  ☆51Updated last week
• FFY0 / AdaKV
  The Official Implementation of Ada-KV: Optimizing KV Cache Eviction by Adaptive Budget Allocation for Efficient LLM Inference
  ☆58Updated 3 weeks ago
• SkyworkAI / skywork-o1-prm-inference
  ☆57Updated 2 months ago
• CASIA-IVA-Lab / FLAP
  [AAAI 2024] Fluctuation-based Adaptive Structured Pruning for Large Language Models
  ☆43Updated last year
• smart-lty / ParallelSpeculativeDecoding
  [ICLR 2025] PEARL: parallel speculative decoding with adaptive draft length
  ☆37Updated this week
• Outsider565 / LoRA-GA
  ☆177Updated 4 months ago
• NJUNLP / MCSD
  Multi-Candidate Speculative Decoding
  ☆34Updated 9 months ago
• pprp / Awesome-Efficient-MoE
  Efficient Mixture of Experts for LLM Paper List
  ☆35Updated 2 months ago
• Chongjie-Si / Subspace-Tuning
  A generalized framework for subspace tuning methods in parameter efficient fine-tuning.
  ☆128Updated 2 weeks ago
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆128Updated 8 months ago
• SqueezeAILab / SqueezedAttention
  SQUEEZED ATTENTION: Accelerating Long Prompt LLM Inference
  ☆40Updated 3 months ago
• Wangmerlyn / MCTS-GSM8k-Demo
  This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems
  ☆49Updated last month
• SUSTechBruce / LOOK-M
  [EMNLP 2024 Findings🔥] Official implementation of "LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context Infe…
  ☆91Updated 3 months ago
• madsys-dev / deepseekv2-profile
  ☆101Updated 6 months ago
• ClubieDong / QAQ-KVCacheQuantization
  QAQ: Quality Adaptive Quantization for LLM KV Cache
  ☆46Updated 10 months ago
• sramshetty / ShortGPT
  Unofficial implementations of block/layer-wise pruning methods for LLMs.
  ☆62Updated 9 months ago
• Lucky-Lance / Expert_Sparsity
  [ACL 2024] Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models
  ☆82Updated 8 months ago
• Dominic789654 / LongGenBench
  Source code for the paper "LongGenBench: Long-context Generation Benchmark"
  ☆14Updated 4 months ago
• YouAreSpecialToMe / QST
  Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models
  ☆42Updated 3 months ago
• sramshetty / mixture-of-depths
  An unofficial implementation of "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆35Updated 8 months ago
• wutaiqiang / MoSLoRA
  ☆93Updated 7 months ago
• mrflogs / LoRA-Pro
  Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "
  ☆101Updated 3 months ago
• ruikangliu / IntactKV
  Official PyTorch implementation of IntactKV: Improving Large Language Model Quantization by Keeping Pivot Tokens Intact
  ☆40Updated 8 months ago
• hyperai / triton-cn
  Triton Documentation in Chinese Simplified / Triton 中文文档
  ☆54Updated last month
• htqin / IR-QLoRA
  [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retenti…
  ☆60Updated 10 months ago
• pprp / Awesome-LLM-Quantization
  Awesome list for LLM quantization
  ☆170Updated last month
• liyunqianggyn / Awesome-LLMs-Pruning
  Awesome LLM pruning papers all-in-one repository with integrating all useful resources and insights.
  ☆70Updated 2 months ago
• Gaffey / ExCP
  Official implementation of ICML 2024 paper "ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinking".
  ☆46Updated 7 months ago
• pprp / Pruner-Zero
  Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for LLMs
  ☆77Updated 2 months ago