Alternatives and similar repositories for AngelSlim

Users that are interested in AngelSlim are comparing it to the libraries listed below

• JT-Ushio / MHA2MLA
  Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
  ☆203Updated last month
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆274Updated 5 months ago
• intelligent-machine-learning / atorch
  An industrial extension library of pytorch to accelerate large scale model training
  ☆58Updated 5 months ago
• OpenBMB / CPM.cu
  CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge tec…
  ☆223Updated 2 weeks ago
• stepfun-ai / Step3
  ☆449Updated 5 months ago
• zai-org / GLM-Edge
  GLM Series Edge Models
  ☆156Updated 7 months ago
• inferflow / inferflow
  Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
  ☆251Updated last year
• ByteDance-Seed / decoupleQ
  A quantization algorithm for LLM
  ☆148Updated last year
• qingkelab / qingketalk
  青稞Talk
  ☆190Updated last week
• HandH1998 / QQQ
  QQQ is an innovative and hardware-optimized W4A8 quantization solution for LLMs.
  ☆154Updated 5 months ago
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆139Updated last year
• DeepLink-org / dlinfer
  ☆74Updated last week
• ModelTC / LightCompress
  [EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.
  ☆669Updated 2 months ago
• TencentARC / mllm-npu
  mllm-npu: training multimodal large language models on Ascend NPUs
  ☆95Updated last year
• flagos-ai / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆471Updated this week
• AniZpZ / AutoSmoothQuant
  An easy-to-use package for implementing SmoothQuant for LLMs
  ☆110Updated 9 months ago
• OpenGVLab / EfficientQAT
  [ACL 2025 Main] EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆326Updated 2 months ago
• thunlp / Delta-CoMe
  Delta-CoMe can achieve near loss-less 1-bit compressin which has been accepted by NeurIPS 2024
  ☆58Updated last year
• neuralmagic / AutoFP8
  ☆206Updated 8 months ago
• Efficient-ML / Qwen3-Quantization
  ☆66Updated 4 months ago
• modelscope / easydistill
  a toolkit on knowledge distillation for large language models
  ☆261Updated last month
• NVlabs / COAT
  [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training
  ☆258Updated 5 months ago
• wejoncy / QLLM
  A general 2-8 bits quantization toolbox with GPTQ/AWQ/HQQ/VPTQ, and export to onnx/onnx-runtime easily.
  ☆184Updated 9 months ago
• IsaacRe / vllm-kvcompress
  KV cache compression for high-throughput LLM inference
  ☆150Updated 11 months ago
• NVIDIA / Star-Attention
  Efficient LLM Inference over Long Sequences
  ☆394Updated 7 months ago
• InternLM / InternEvo
  InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencie…
  ☆417Updated 5 months ago
• inclusionAI / Ling
  Ling is a MoE LLM provided and open-sourced by InclusionAI.
  ☆238Updated 8 months ago
• mit-han-lab / duo-attention
  [ICLR 2025] DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads
  ☆523Updated 11 months ago
• OpenBMB / infllmv2_cuda_impl
  ☆86Updated this week
• pprp / Awesome-Efficient-MoE
  Efficient Mixture of Experts for LLM Paper List
  ☆160Updated 4 months ago