Alternatives and similar repositories for APE:

Users that are interested in APE are comparing it to the libraries listed below

• Jingyu6 / speculative_prefill
  ☆20Updated this week
• hyx1999 / SAM-Decoding
  Official Implementation of SAM-Decoding: Speculative Decoding via Suffix Automaton
  ☆23Updated last month
• dvlab-research / Q-LLM
  This is the official repo of "QuickLLaMA: Query-aware Inference Acceleration for Large Language Models"
  ☆45Updated 8 months ago
• alessiodevoto / l2compress
  Code for the EMNLP24 paper "A simple and effective L2 norm based method for KV Cache compression."
  ☆11Updated 3 months ago
• HKUNLP / critic-rl
  Code for Paper: Teaching Language Models to Critique via Reinforcement Learning
  ☆84Updated last month
• Zanette-Labs / SpeculativeRejection
  [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection
  ☆40Updated 5 months ago
• sail-sg / SimLayerKV
  The official implementation of paper: SimLayerKV: A Simple Framework for Layer-Level KV Cache Reduction.
  ☆44Updated 5 months ago
• hdong920 / GRIFFIN
  ☆36Updated 7 months ago
• machilusZ / FastGen
  This repo contains the source code for: Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs
  ☆35Updated 7 months ago
• DerrickYLJ / TidalDecode
  [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention
  ☆31Updated 3 weeks ago
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆33Updated 6 months ago
• amazon-science / llm-code-preference
  Training and Benchmarking LLMs for Code Preference.
  ☆33Updated 4 months ago
• LINs-lab / DeFT
  [ICLR 2025] DeFT: Decoding with Flash Tree-attention for Efficient Tree-structured LLM Inference
  ☆19Updated last week
• GeniusHTX / TALE
  ☆82Updated last week
• OpenSparseLLMs / Linear-MoE
  ☆72Updated last week
• ganler / code-r1
  Reproducing R1 for Code with Reliable Rewards
  ☆140Updated 3 weeks ago
• JayZhang42 / SLED
  SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433
  ☆24Updated 3 months ago
• Dominic789654 / LongGenBench
  Source code for the paper "LongGenBench: Long-context Generation Benchmark"
  ☆15Updated 5 months ago
• sail-sg / LongSpec
  LongSpec: Long-Context Speculative Decoding with Efficient Drafting and Verification
  ☆42Updated 3 weeks ago
• ZetangForward / LCM_Stack
  Code for paper: Long cOntext aliGnment via efficient preference Optimization
  ☆13Updated last month
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆44Updated this week
• raymin0223 / fast_robust_early_exit
  Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)
  ☆57Updated 6 months ago
• metacarbon / shareAtt
  Beyond KV Caching: Shared Attention for Efficient LLMs
  ☆16Updated 8 months ago
• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆50Updated 6 months ago
• mathllm / Step-Controlled_DPO
  ☆21Updated 8 months ago
• uservan / ThinkPO
  ☆17Updated last month
• chenllliang / MMEvalPro
  [NAACL 2025] Source code for MMEvalPro, a more trustworthy and efficient benchmark for evaluating LMMs
  ☆23Updated 6 months ago
• smart-lty / ParallelSpeculativeDecoding
  [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length
  ☆67Updated 2 weeks ago
• zyxxmu / cam
  Pytorch implementation of our paper accepted by ICML 2024 -- CaM: Cache Merging for Memory-efficient LLMs Inference
  ☆35Updated 9 months ago
• jinzhuoran / RAG-RewardBench
  RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment
  ☆16Updated 3 months ago