Alternatives and similar repositories for APOLLO:

Users that are interested in APOLLO are comparing it to the libraries listed below

• AIoT-MLSys-Lab / SVD-LLM
  [ICLR 2025🔥] SVD-LLM & [NAACL 2025🔥] SVD-LLM V2
  ☆189Updated last week
• Infini-AI-Lab / TriForce
  [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding
  ☆242Updated 6 months ago
• uclaml / SPPO
  The official implementation of Self-Play Preference Optimization (SPPO)
  ☆508Updated 2 months ago
• bytedance / ShadowKV
  ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference
  ☆153Updated 4 months ago
• Zefan-Cai / KVCache-Factory
  Unified KV Cache Compression Methods for Auto-Regressive Models
  ☆956Updated 2 months ago
• bytedance / ABQ-LLM
  An acceleration library that supports arbitrary bit-width combinatorial quantization operations
  ☆218Updated 5 months ago
• Ledzy / BAdam
  [NeurIPS 2024] BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models
  ☆249Updated 2 weeks ago
• xinghaow99 / BitStack
  [ICLR 2025] BitStack: Any-Size Compression of Large Language Models in Variable Memory Environments
  ☆36Updated last month
• RLHFlow / Self-rewarding-reasoning-LLM
  Recipes to train the self-rewarding reasoning LLMs.
  ☆207Updated 3 weeks ago
• FasterDecoding / TEAL
  ☆118Updated last month
• xiayuqing0622 / flex_head_fa
  Fast and memory-efficient exact attention
  ☆67Updated 3 weeks ago
• Qcompiler / MIXQ
  MIXQ: Taming Dynamic Outliers in Mixed-Precision Quantization by Online Prediction
  ☆83Updated 4 months ago
• thu-ml / low-bit-optimizers
  Low-bit optimizers for PyTorch
  ☆125Updated last year
• AGI-Arena / MARS
  The official implementation of MARS: Unleashing the Power of Variance Reduction for Training Large Models
  ☆579Updated last month
• RLHFlow / Online-DPO-R1
  Codebase for Iterative DPO Using Rule-based Rewards
  ☆227Updated last month
• shadowpa0327 / Palu
  [ICLR 2025] Palu: Compressing KV-Cache with Low-Rank Projection
  ☆91Updated last month
• mit-han-lab / x-attention
  XAttention: Block Sparse Attention with Antidiagonal Scoring
  ☆102Updated this week
• thu-ml / ReMoE
  [ICLR2025] Codebase for "ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing", built on Megatron-LM.
  ☆65Updated 3 months ago
• fla-org / flame
  🔥 A minimal training framework for scaling FLA models
  ☆82Updated last week
• XunhaoLai / native-sparse-attention-triton
  Efficient triton implementation of Native Sparse Attention.
  ☆116Updated this week
• NVlabs / COAT
  [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training
  ☆168Updated last month
• Qihoo360 / 360-LLaMA-Factory
  adds Sequence Parallelism into LLaMA-Factory
  ☆432Updated this week
• LZY-the-boys / Twin-Merging
  [NeurIPS2024] Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging
  ☆133Updated last week
• IAAR-Shanghai / ICSFSurvey
  Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasonin…
  ☆162Updated 3 months ago
• Lucky-Lance / Expert_Sparsity
  [ACL 2024] Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models
  ☆85Updated 10 months ago
• opengear-project / GEAR
  GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM
  ☆157Updated 8 months ago
• Qcompiler / MixQ_Tensorrt_LLM
  Mixed precision inference by Tensorrt-LLM
  ☆79Updated 5 months ago
• Qcompiler / vllm-mixed-precision
  Support mixed-precsion inference with vllm
  ☆80Updated 2 months ago
• Hannibal046 / nanoRWKV
  The nanoGPT-style implementation of RWKV Language Model - an RNN with GPT-level LLM performance.
  ☆185Updated last year
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆196Updated 8 months ago