Alternatives and similar repositories for KVCache-Factory:

Users that are interested in KVCache-Factory are comparing it to the libraries listed below

• bytedance / ABQ-LLM
  An acceleration library that supports arbitrary bit-width combinatorial quantization operations
  ☆215Updated 4 months ago
• HJYao00 / Mulberry
  Mulberry, an o1-like Reasoning and Reflection MLLM Implemented via Collective MCTS
  ☆618Updated this week
• Infini-AI-Lab / TriForce
  [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding
  ☆239Updated 5 months ago
• GreenBitAI / bitorch-engine
  A toolkit enhances PyTorch with specialized functions for low-bit quantized neural networks.
  ☆196Updated 7 months ago
• zhihu / ZhiLight
  A highly optimized LLM inference acceleration engine for Llama and its variants.
  ☆855Updated this week
• AGI-Arena / MARS
  The official implementation of MARS: Unleashing the Power of Variance Reduction for Training Large Models
  ☆534Updated last week
• Alpha-Innovator / AdaptiveDiffusion
  [NeurIPS'24] Training-Free Adaptive Diffusion with Bounded Difference Approximation Strategy
  ☆61Updated 3 weeks ago
• AlgRUC / JittorGeometric
  JittorGeometric is a Jittor-based graph machine learning library.
  ☆127Updated last month
• Alpha-Innovator / Chimera
  Improving Generalist Model with Domain-Specific Experts
  ☆82Updated last month
• dle666 / R-CoT
  Reverse Chain-of-Thought Problem Generation for Geometric Reasoning in Large Multimodal Models
  ☆170Updated 3 months ago
• jordddan / Pruning-LLMs
  The framework to prune LLMs to any size and any config.
  ☆87Updated 11 months ago
• uclaml / SPPO
  The official implementation of Self-Play Preference Optimization (SPPO)
  ☆481Updated 3 weeks ago
• lerogo / MMGenBench
  Official repository of MMGenBench
  ☆119Updated 2 months ago
• gersteinlab / ML-Bench
  The Official Repo of ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Code (https://a…
  ☆287Updated 3 months ago
• Elfsong / Mercury
  Code Efficiency Benchmark
  ☆70Updated last month
• PKU-Alignment / align-anything
  Align Anything: Training All-modality Model with Feedback
  ☆2,154Updated this week
• HITsz-TMG / UMOE-Scaling-Unified-Multimodal-LLMs
  The codes about "Uni-MoE: Scaling Unified Multimodal Models with Mixture of Experts"
  ☆689Updated 3 weeks ago
• Alpha-Innovator / DocGenome
  DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Models
  ☆127Updated last month
• guanchuwang / redis-bench
  ☆421Updated 5 months ago
• gordonhu608 / MQT-LLaVA
  [NeurIPS 2024] Matryoshka Query Transformer for Large Vision-Language Models
  ☆96Updated 7 months ago
• yewentao256 / MicroTorch
  A Tiny structure of pytorch for learning;
  ☆55Updated 7 months ago
• bytedance / ShadowKV
  ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference
  ☆148Updated 3 months ago
• Qcompiler / MIXQ
  MIXQ: Taming Dynamic Outliers in Mixed-Precision Quantization by Online Prediction
  ☆79Updated 3 months ago
• Ablustrund / MPLSandbox
  MPLSandbox is an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler a…
  ☆172Updated 3 months ago
• Qcompiler / vllm-mixed-precision
  Support mixed-precsion inference with vllm
  ☆80Updated last month
• dvlab-research / Lyra
  Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition
  ☆276Updated last month
• Ledzy / BAdam
  [NeurIPS 2024] BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models
  ☆243Updated 2 months ago
• EvolvingLMMs-Lab / lmms-eval
  Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.
  ☆2,116Updated this week