Alternatives and similar repositories for Helen

Users that are interested in Helen are comparing it to the libraries listed below

• FFY0 / AdaKV
  The Official Implementation of Ada-KV: Optimizing KV Cache Eviction by Adaptive Budget Allocation for Efficient LLM Inference
  ☆79Updated 5 months ago
• thunlp / MoEfication
  ☆137Updated 11 months ago
• sail-sg / LongSpec
  LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification
  ☆54Updated 3 months ago
• CASIA-IVA-Lab / FLAP
  [AAAI 2024] Fluctuation-based Adaptive Structured Pruning for Large Language Models
  ☆54Updated last year
• Gaffey / ExCP
  Official implementation of ICML 2024 paper "ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinking".
  ☆48Updated 11 months ago
• HKUDS / SepLLM
  [ICML 2025] "SepLLM: Accelerate Large Language Models by Compressing One Segment into One Separator"
  ☆75Updated this week
• yxli2123 / LoSparse
  ☆57Updated last year
• SalesforceAIResearch / ThinK
  ThinK: Thinner Key Cache by Query-Driven Pruning
  ☆20Updated 4 months ago
• bailuding / rails
  Retrieval with Learned Similarities (http://arxiv.org/abs/2407.15462, WWW'25 Oral)
  ☆43Updated 2 months ago
• cliang1453 / task-aware-distillation
  Less is More: Task-aware Layer-wise Distillation for Language Model Compression (ICML2023)
  ☆35Updated last year
• SqueezeAILab / SqueezedAttention
  SQUEEZED ATTENTION: Accelerating Long Prompt LLM Inference
  ☆47Updated 7 months ago
• smart-lty / ParallelSpeculativeDecoding
  [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length
  ☆90Updated 2 months ago
• staoxiao / LibVQ
  ☆74Updated 2 years ago
• machilusZ / FastGen
  This repo contains the source code for: Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs
  ☆38Updated 10 months ago
• zhengzangw / Sequence-Scheduling
  PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".
  ☆88Updated 2 years ago
• junkangwu / beta-DPO
  [NeurIPS 2024] Official code of $\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$
  ☆45Updated 8 months ago
• mutonix / pyramidinfer
  ☆42Updated 7 months ago
• USTC-StarTeam / ZIP
  ☆22Updated 11 months ago
• hdong920 / LESS
  ☆50Updated last year
• bethgelab / sober-reasoning
  A Sober Look at Language Model Reasoning
  ☆74Updated last week
• SimiaoZuo / MoEBERT
  This PyTorch package implements MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation (NAACL 2022).
  ☆107Updated 3 years ago
• henryzhongsc / longctx_bench
  Official implementation for Yuan & Liu & Zhong et al., KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark o…
  ☆79Updated 4 months ago
• zhzihao / QPruningKV
  More Tokens, Lower Precision: Towards the Optimal Token-Precision Trade-off in KV Cache Compression
  ☆11Updated 5 months ago
• uservan / ThinkPO
  ☆19Updated 4 months ago
• Zanette-Labs / SpeculativeRejection
  [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection
  ☆45Updated 7 months ago
• swtheing / PF-PPO-RLHF
  ☆33Updated 9 months ago
• NonvolatileMemory / flash_tree_attn
  ☆19Updated 6 months ago
• namespace-Pt / UltraGist
  ☆18Updated 6 months ago
• HugoZHL / MEVI
  [NeurIPS 2023] Model-enhanced Vector Index
  ☆26Updated last year
• LiuXiaoxuanPKU / OSD
  ☆52Updated 6 months ago