Alternatives and similar repositories for DeepTrace

Users that are interested in DeepTrace are comparing it to the libraries listed below

• LLM-Semantic-Router / vllm-router
  vLLM Router
  ☆51Updated last year
• tensorchord / deepseek-api-arena
  A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.
  ☆30Updated 8 months ago
• FlyAIBox / dcu-in-action
  国产加速卡-海光DCU实战（大模型训练、微调、推理 等）
  ☆60Updated 4 months ago
• vllm-project / vllm-nccl
  Manages vllm-nccl dependency
  ☆17Updated last year
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆131Updated 2 months ago
• zhaochenyang20 / ModelServer
  Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang
  ☆61Updated last year
• Oneflow-Inc / serving
  OneFlow Serving
  ☆20Updated 8 months ago
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆41Updated last year
• hellangleZ / Qwen3_autothink_adapter
  Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…
  ☆22Updated 7 months ago
• thunlp / Delta-CoMe
  Delta-CoMe can achieve near loss-less 1-bit compressin which has been accepted by NeurIPS 2024
  ☆59Updated last year
• GeeeekExplorer / transformers-patch
  patches for huggingface transformers to save memory
  ☆32Updated 6 months ago
• thunlp / APB
  Official Implementation of APB (ACL 2025 main Oral)
  ☆32Updated 9 months ago
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆137Updated last year
• SkyworkAI / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆16Updated last year
• zenrran4nlp / Awesome-LLM-Inference-Serving
  ☆46Updated 7 months ago
• zartbot / stock_analyzer
  ☆21Updated 4 months ago
• rayleizhu / vllm-ra
  [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts
  ☆40Updated last year
• Laoyu84 / 4onebench
  A minimalist benchmarking tool designed to test the routine-generation capabilities of LLMs.
  ☆27Updated last year
• OpenSQZ / MegatronApp
  Toolchain built around the Megatron-LM for Distributed Training
  ☆79Updated last week
• bentoml / llm-bench
  ☆56Updated last year
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆45Updated this week
• inclusionAI / asystem-awex
  A high-performance RL training-inference weight synchronization framework, designed to enable second-level parameter updates from trainin…
  ☆109Updated last week
• intelligent-machine-learning / atorch
  An industrial extension library of pytorch to accelerate large scale model training
  ☆55Updated 4 months ago
• pangu-tech / pangu-ultra
  ☆74Updated 6 months ago
• PaddlePaddle / PaddleFlow
  ☆123Updated 9 months ago
• xverse-ai / XVERSE-MoE-A4.2B
  XVERSE-MoE-A4.2B: A multilingual large language model developed by XVERSE Technology Inc.
  ☆39Updated last year
• tensorchord / modelz-ChatGLM
  Deploy ChatGLM on Modelz
  ☆16Updated 2 years ago
• inferflow / inferflow
  Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
  ☆250Updated last year
• OpenCSGs / llm-inference
  llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…
  ☆89Updated last year
• Ascend / AscendSpeed
  ☆79Updated 2 years ago