Alternatives and similar repositories for SpeculativeRejection

Users that are interested in SpeculativeRejection are comparing it to the libraries listed below

• Linking-ai / SCOPE

  View on GitHub
  (ACL 2025 oral) SCOPE: Optimizing KV Cache Compression in Long-context Generation
  ☆34May 28, 2025Updated 8 months ago
• sail-sg / SimLayerKV

  View on GitHub
  The official implementation of paper: SimLayerKV: A Simple Framework for Layer-Level KV Cache Reduction.
  ☆52Oct 18, 2024Updated last year
• init0xyz / AdaCQR

  View on GitHub
  Implementation of AdaCQR(COLING 2025)
  ☆13Dec 30, 2024Updated last year
• Infini-AI-Lab / TriForce

  View on GitHub
  [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding
  ☆276Aug 31, 2024Updated last year
• Jikai0Wang / OPT-Tree

  View on GitHub
  ☆28May 24, 2025Updated 8 months ago
• hao-ai-lab / Dynasor

  View on GitHub
  [NeurIPS 2025] Simple extension on vLLM to help you speed up reasoning model without training.
  ☆220May 31, 2025Updated 8 months ago
• nick7nlp / FastCuRL

  View on GitHub
  FastCuRL: Curriculum Reinforcement Learning with Stage-wise Context Scaling for Efficient LLM Reasoning
  ☆57Oct 10, 2025Updated 4 months ago
• mutonix / pyramidinfer

  View on GitHub
  ☆49Nov 25, 2024Updated last year
• gl-ybnbxb / BoNBoN

  View on GitHub
  ☆18Jun 3, 2024Updated last year
• hyx1999 / SAM-Decoding

  View on GitHub
  Official Implementation of SAM-Decoding: Speculative Decoding via Suffix Automaton
  ☆40Feb 13, 2025Updated last year
• akhilkedia / TranformersGetStable

  View on GitHub
  [ICML 2024] Official Repository for the paper "Transformers Get Stable: An End-to-End Signal Propagation Theory for Language Models"
  ☆10Jul 19, 2024Updated last year
• hemingkx / SWIFT

  View on GitHub
  [ICLR 2025] SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration
  ☆61Feb 21, 2025Updated 11 months ago
• rohinmanvi / Capability-Aware-and-Mid-Generation-Self-Evaluations

  View on GitHub
  ☆21Jul 25, 2025Updated 6 months ago
• Leooyii / LCEG

  View on GitHub
  Long Context Extension and Generalization in LLMs
  ☆62Sep 21, 2024Updated last year
• Jingyu6 / speculative_prefill

  View on GitHub
  ☆53May 19, 2025Updated 8 months ago
• ritaranx / Collab-RAG

  View on GitHub
  ☆29Apr 8, 2025Updated 10 months ago
• ByteDance-Seed / ShadowKV

  View on GitHub
  [ICML 2025 Spotlight] ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference
  ☆283May 1, 2025Updated 9 months ago
• ZHZisZZ / weak-to-strong-search

  View on GitHub
  [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models
  ☆66Dec 10, 2024Updated last year
• bytedance / FTRL

  View on GitHub
  Feedback-Driven Tool-Use Improvements in Large Language Models via Automated Build Environments
  ☆48Jan 8, 2026Updated last month
• Infini-AI-Lab / MagicDec

  View on GitHub
  [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆142Dec 4, 2024Updated last year
• ByteDance-Seed / FlexPrefill

  View on GitHub
  Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference
  ☆160Oct 13, 2025Updated 4 months ago
• sail-sg / CPO

  View on GitHub
  [NeurIPS 2024] The official implementation of paper: Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs.
  ☆134Mar 21, 2025Updated 10 months ago
• QwenLM / ProcessBench

  View on GitHub
  Official repository for ACL 2025 paper "ProcessBench: Identifying Process Errors in Mathematical Reasoning"
  ☆184May 20, 2025Updated 8 months ago
• andy-yang-1 / DoubleSparse

  View on GitHub
  16-fold memory access reduction with nearly no loss
  ☆110Mar 26, 2025Updated 10 months ago
• zjunlp / LookAheadTuning

  View on GitHub
  [WSDM 2026] LookAhead Tuning: Safer Language Models via Partial Answer Previews
  ☆17Dec 14, 2025Updated 2 months ago
• David-Li0406 / SMoA

  View on GitHub
  ☆14Jan 24, 2025Updated last year
• zhang677 / PCL-lite

  View on GitHub
  Code for "Adaptive Self-improvement LLM Agentic System for ML Library Development" (ICML 2025)
  ☆15Jan 6, 2026Updated last month
• Lyun0912-wu / LongAttn

  View on GitHub
  LongAttn ：Selecting Long-context Training Data via Token-level Attention
  ☆15Jul 16, 2025Updated 7 months ago
• jixjia / call_center_ai

  View on GitHub
  ☆17Apr 2, 2025Updated 10 months ago
• EachSheep / RAGSynth

  View on GitHub
  The implementation of RAGSynth: Synthetic Data for Robust and Faithful RAG Component Optimization
  ☆21May 26, 2025Updated 8 months ago
• OpenLMLab / scaling-rope

  View on GitHub
  code for Scaling Laws of RoPE-based Extrapolation
  ☆73Oct 16, 2023Updated 2 years ago
• microsoft / chunk-attention

  View on GitHub
  ☆85Apr 18, 2025Updated 9 months ago
• October2001 / ProLong

  View on GitHub
  [ACL 2024 (Oral)] A Prospector of Long-Dependency Data for Large Language Models
  ☆59Jul 23, 2024Updated last year
• yangyifei729 / KVSharer

  View on GitHub
  Source code of paper ''KVSharer: Efficient Inference via Layer-Wise Dissimilar KV Cache Sharing''
  ☆31Oct 24, 2024Updated last year
• princeton-nlp / ProLong

  View on GitHub
  Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"
  ☆246Sep 12, 2025Updated 5 months ago
• OpenMOSS / LongLLaDA

  View on GitHub
  [AAAI26] LongLLaDA: Unlocking Long Context Capabilities in Diffusion LLMs
  ☆52Dec 7, 2025Updated 2 months ago
• john-hewitt / implicit-ins

  View on GitHub
  Codebase for Instruction Following without Instruction Tuning
  ☆36Sep 24, 2024Updated last year
• Adaxry / Unified_Layer_Skipping

  View on GitHub
  ☆15Apr 11, 2024Updated last year
• cambridgeltl / topviewrs

  View on GitHub
  TopViewRS: Vision-Language Models as Top-View Spatial Reasoners (EMNLP 2024 Oral)
  ☆15Jun 14, 2025Updated 8 months ago