Alternatives and similar repositories for DeepTrace

Users that are interested in DeepTrace are comparing it to the libraries listed below

• vllm-project / vllm-nccl
  Manages vllm-nccl dependency
  ☆17Updated last year
• zhaochenyang20 / ModelServer
  Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang
  ☆61Updated last year
• thunlp / APB
  Official Implementation of APB (ACL 2025 main Oral)
  ☆32Updated 10 months ago
• tensorchord / deepseek-api-arena
  A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.
  ☆30Updated 9 months ago
• OpenSQZ / MegatronApp
  Toolchain built around the Megatron-LM for Distributed Training
  ☆80Updated last month
• JerryYin777 / PaperHelper
  PaperHelper: Knowledge-Based LLM QA Paper Reading Assistant with Reliable References
  ☆20Updated last year
• rayleizhu / vllm-ra
  [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts
  ☆40Updated last year
• thunlp / Delta-CoMe
  Delta-CoMe can achieve near loss-less 1-bit compressin which has been accepted by NeurIPS 2024
  ☆59Updated last year
• GeeeekExplorer / transformers-patch
  patches for huggingface transformers to save memory
  ☆32Updated 7 months ago
• zartbot / stock_analyzer
  ☆21Updated 5 months ago
• Laoyu84 / 4onebench
  A minimalist benchmarking tool designed to test the routine-generation capabilities of LLMs.
  ☆27Updated last year
• Gaffey / ExCP
  Official implementation of ICML 2024 paper "ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinking".
  ☆47Updated last year
• SkyworkAI / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆17Updated last year
• sgl-project / sgl-flash-attn
  Fast and memory-efficient exact attention
  ☆15Updated this week
• hellangleZ / Qwen3_autothink_adapter
  Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…
  ☆22Updated 8 months ago
• inclusionAI / asystem-awex
  A high-performance RL training-inference weight synchronization framework, designed to enable second-level parameter updates from trainin…
  ☆123Updated 2 weeks ago
• tile-ai / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆19Updated this week
• bytedance-iaas / sglang
  SGLang is a fast serving framework for large language models and vision language models.
  ☆17Updated this week
• qhjqhj00 / MetaAgent
  MetaAgent: Toward Self-Evolving Agent via Tool Meta-Learning
  ☆41Updated 4 months ago
• Oneflow-Inc / serving
  OneFlow Serving
  ☆20Updated 8 months ago
• llm-semantic-router / vllm-router
  vLLM Router
  ☆54Updated last year
• FlyAIBox / dcu-in-action
  国产加速卡-海光DCU实战（大模型训练、微调、推理 等）
  ☆64Updated 4 months ago
• rlite-project / RLite
  A lightweight reinforcement learning framework that integrates seamlessly into your codebase, empowering developers to focus on algorithm…
  ☆96Updated 4 months ago
• ModelTC / awesome-lm-system
  Summary of system papers/frameworks/codes/tools on training or serving large model
  ☆57Updated 2 years ago
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆40Updated 2 years ago
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆82Updated 10 months ago
• Infini-AI-Lab / APE
  ☆36Updated 10 months ago
• zhaochenyang20 / Prompt2Model-Self-Guide
  SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper
  ☆32Updated last year
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆38Updated 8 months ago
• inferflow / inferflow
  Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
  ☆250Updated last year