Alternatives and similar repositories for TokenRecycling

Users that are interested in TokenRecycling are comparing it to the libraries listed below

• mutonix / pyramidinfer
  ☆49Updated last year
• dilab-zju / self-speculative-decoding
  Code associated with the paper **Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding**
  ☆214Updated 11 months ago
• LCLM-Horizon / A-Comprehensive-Survey-For-Long-Context-Language-Modeling
  A Comprehensive Survey on Long Context Language Modeling
  ☆219Updated 2 months ago
• princeton-nlp / ProLong
  Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"
  ☆245Updated 4 months ago
• hemingkx / Spec-Bench
  Spec-Bench: A Comprehensive Benchmark and Unified Evaluation Platform for Speculative Decoding (ACL 2024 Findings)
  ☆357Updated 9 months ago
• AIoT-MLSys-Lab / D2O
  [ICLR 2025🔥] D2O: Dynamic Discriminative Operations for Efficient Long-Context Inference of Large Language Models
  ☆27Updated 6 months ago
• FasterDecoding / SnapKV
  ☆302Updated 6 months ago
• OpenMOSS / Thus-Spake-Long-Context-LLM
  a survey of long-context LLMs from four perspectives, architecture, infrastructure, training, and evaluation
  ☆61Updated 10 months ago
• ISEEKYAN / mbridge
  Bridge Megatron-Core to Hugging Face/Reinforcement Learning
  ☆188Updated this week
• HArmonizedSS / HASS
  Official Implementation of "Learning Harmonized Representations for Speculative Sampling" (HASS)
  ☆52Updated 10 months ago
• smart-lty / ParallelSpeculativeDecoding
  [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length
  ☆148Updated last month
• Zanette-Labs / efficient-reasoning
  ☆73Updated 9 months ago
• hemingkx / TokenSkip
  [EMNLP 2025] TokenSkip: Controllable Chain-of-Thought Compression in LLMs
  ☆200Updated 2 months ago
• mozhu621 / LongGenBench
  ☆29Updated 3 months ago
• ganler / code-r1
  Reproducing R1 for Code with Reliable Rewards
  ☆282Updated 8 months ago
• OpenBMB / InfiniteBench
  Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718
  ☆370Updated last year
• infinigence / LVEval
  Repository of LV-Eval Benchmark
  ☆73Updated last year
• mtbench101 / mt-bench-101
  [ACL 2024] MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues
  ☆138Updated last year
• microsoft / SeerAttention
  SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs
  ☆187Updated 4 months ago
• thunlp / FR-Spec
  [ACL 2025 main] FR-Spec: Frequency-Ranked Speculative Sampling
  ☆49Updated 6 months ago
• ZubinGou / math-evaluation-harness
  A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨
  ☆273Updated last year
• yaof20 / Flash-RL
  Implementation for FP8/INT8 Rollout for RL training without performence drop.
  ☆288Updated 2 months ago
• NonvolatileMemory / GliDe_with_a_CaPE_ICML_24
  official code for GliDe with a CaPE
  ☆20Updated last year
• tongyx361 / symeval
  Evaluation utilities based on SymPy.
  ☆21Updated last year
• NJUNLP / MCSD
  Multi-Candidate Speculative Decoding
  ☆39Updated last year
• FYYFU / HeadKV
  [ICLR2025] Code and data for paper: Not All Heads Matter: A Head-Level KV Cache Compression Method with Integrated Retrieval and Reasonin…
  ☆40Updated 10 months ago
• OpenSparseLLMs / Linear-MoE
  ☆129Updated 7 months ago
• hahahawu / Long-to-Short-via-Model-Merging
  Model merging is a highly efficient approach for long-to-short reasoning.
  ☆98Updated 3 months ago
• OpenCoder-llm / opc_data_filtering
  Heuristic filtering framework for RefineCode
  ☆82Updated 10 months ago
• Hongcheng-Gao / Awesome-Long2short-on-LRMs
  Awesome-Long2short-on-LRMs is a collection of state-of-the-art, novel, exciting long2short methods on large reasoning models. It contains…
  ☆258Updated 5 months ago