Alternatives and similar repositories for MT2ST:

Users that are interested in MT2ST are comparing it to the libraries listed below

• NoakLiu / DRTR
  Adaptive Topology Reconstruction for Robust Graph Representation Learning [Efficient ML Model]
  ☆11Updated last month
• NoakLiu / Efficient-Foundation-Models-Survey
  Efficient-Large-Foundation-Model-Inference: A-Perspective-From-Model-and-System-Co-Design [Efficient ML System & Model]
  ☆22Updated last month
• NoakLiu / GraphSnapShot
  GraphSnapShot: Caching Local Structure for Fast Graph Learning [Efficient ML System]
  ☆30Updated 4 months ago
• NoakLiu / LLMEasyQuant
  An Easy-to-Use Toolkit for LLM Quantization on can be executed on Macbook [Efficient ML Model]
  ☆18Updated 3 months ago
• NJUNLP / MCSD
  Multi-Candidate Speculative Decoding
  ☆35Updated 11 months ago
• zyxxmu / cam
  Pytorch implementation of our paper accepted by ICML 2024 -- CaM: Cache Merging for Memory-efficient LLMs Inference
  ☆35Updated 9 months ago
• LiuXiaoxuanPKU / OSD
  ☆47Updated 4 months ago
• FFY0 / AdaKV
  The Official Implementation of Ada-KV: Optimizing KV Cache Eviction by Adaptive Budget Allocation for Efficient LLM Inference
  ☆69Updated 2 months ago
• hemingkx / SWIFT
  [ICLR 2025] SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration
  ☆45Updated last month
• TreeAI-Lab / Awesome-KV-Cache-Management
  This repository serves as a comprehensive survey of LLM development, featuring numerous research papers along with their corresponding co…
  ☆102Updated last month
• henryzhongsc / longctx_bench
  Official implementation for Yuan & Liu & Zhong et al., KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark o…
  ☆69Updated last month
• zcli-charlie / Awesome-KV-Cache
  ☆60Updated 6 months ago
• zhengzangw / Sequence-Scheduling
  PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".
  ☆85Updated last year
• smart-lty / ParallelSpeculativeDecoding
  [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length
  ☆71Updated 3 weeks ago
• yangyifei729 / KVSharer
  Source code of paper ''KVSharer: Efficient Inference via Layer-Wise Dissimilar KV Cache Sharing''
  ☆24Updated 5 months ago
• mutonix / pyramidinfer
  ☆39Updated 4 months ago
• snu-comparch / InfiniGen
  InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)
  ☆119Updated 9 months ago
• hemingkx / TokenSkip
  TokenSkip: Controllable Chain-of-Thought Compression in LLMs
  ☆114Updated 3 weeks ago
• thu-pacman / FasterMoE
  ☆81Updated 3 years ago
• hdong920 / LESS
  ☆50Updated 10 months ago
• HugoZHL / PQCache
  [SIGMOD 2025] PQCache: Product Quantization-based KVCache for Long Context LLM Inference
  ☆40Updated 2 months ago
• NUS-HPC-AI-Lab / Helen
  The official implementation of "Helen: Optimizing CTR Prediction Models with Frequency-wise Hessian Eigenvalue Regularization"
  ☆16Updated last year
• AkideLiu / MiniCache
  ☆8Updated 7 months ago
• Xingrun-Xing2 / EfficientLLM
  A family of efficient edge language models in 100M~1B sizes.
  ☆13Updated last month
• hyx1999 / SAM-Decoding
  Official Implementation of SAM-Decoding: Speculative Decoding via Suffix Automaton
  ☆23Updated last month
• YouAreSpecialToMe / QST
  Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models
  ☆42Updated 5 months ago
• d-matrix-ai / keyformer-llm
  ☆53Updated last year
• Equationliu / Kangaroo
  [NeurIPS 2024] The official implementation of "Kangaroo: Lossless Self-Speculative Decoding for Accelerating LLMs via Double Early Exitin…
  ☆51Updated 9 months ago
• dilab-zju / self-speculative-decoding
  Code associated with the paper **Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding**
  ☆177Updated last month
• Infini-AI-Lab / TriForce
  [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding
  ☆245Updated 7 months ago