Alternatives and similar repositories for DeepTrace

Users that are interested in DeepTrace are comparing it to the libraries listed below

• vllm-project / vllm-nccl
  Manages vllm-nccl dependency
  ☆17Updated last year
• zartbot / stock_analyzer
  ☆21Updated 4 months ago
• Gaffey / ExCP
  Official implementation of ICML 2024 paper "ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinking".
  ☆48Updated last year
• inclusionAI / asystem-awex
  A high-performance RL training-inference weight synchronization framework, designed to enable second-level parameter updates from trainin…
  ☆80Updated this week
• LLM-inference-router / vllm-router
  vLLM Router
  ☆51Updated last year
• tensorchord / deepseek-api-arena
  A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.
  ☆30Updated 7 months ago
• zhisbug / ray-scalable-ml-design
  Some microbenchmarks and design docs before commencement
  ☆12Updated 4 years ago
• FlyAIBox / dcu-in-action
  国产加速卡-海光DCU实战（大模型训练、微调、推理 等）
  ☆56Updated 3 months ago
• feifeibear / PyTorchMemTracer
  Depict GPU memory footprint during DNN training of PyTorch
  ☆11Updated 3 years ago
• zenrran4nlp / Awesome-LLM-Inference-Serving
  ☆46Updated 6 months ago
• OpenSQZ / MegatronApp
  Toolchain built around the Megatron-LM for Distributed Training
  ☆76Updated this week
• thunlp / APB
  Official Implementation of APB (ACL 2025 main Oral)
  ☆31Updated 9 months ago
• antgroup / DeepXTrace
  DeepXTrace is a lightweight tool for precisely diagnosing slow ranks in DeepEP-based environments.
  ☆68Updated 2 weeks ago
• GeeeekExplorer / transformers-patch
  patches for huggingface transformers to save memory
  ☆31Updated 5 months ago
• Oneflow-Inc / serving
  OneFlow Serving
  ☆20Updated 7 months ago
• zhaochenyang20 / ModelServer
  Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang
  ☆61Updated last year
• PaddlePaddle / PaddleFlow
  ☆123Updated 9 months ago
• sail-sg / VocabularyParallelism
  Vocabulary Parallelism
  ☆24Updated 8 months ago
• microsoft / tokenweave
  Efficient Compute-Communication Overlap for Distributed LLM Inference
  ☆62Updated 3 weeks ago
• DeepLink-org / DLBlas
  DLBlas: clean and efficient kernels
  ☆23Updated this week
• SkyworkAI / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆16Updated last year
• simon-mo / vLLM-Benchmark
  ☆31Updated 7 months ago
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆80Updated 9 months ago
• ModelTC / awesome-lm-system
  Summary of system papers/frameworks/codes/tools on training or serving large model
  ☆57Updated last year
• tile-ai / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆19Updated this week
• JerryYin777 / PaperHelper
  PaperHelper: Knowledge-Based LLM QA Paper Reading Assistant with Reliable References
  ☆18Updated last year
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆41Updated last year
• rayleizhu / vllm-ra
  [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts
  ☆40Updated last year
• sgl-project / sgl-flash-attn
  Fast and memory-efficient exact attention
  ☆14Updated last week
• RLsys-Foundation / APRIL
  APRIL: Active Partial Rollouts in Reinforcement Learning to Tame Long-tail Generation. A system-level optimization for scalable LLM tra…
  ☆44Updated last month