Alternatives and similar repositories for DeepTrace

Users that are interested in DeepTrace are comparing it to the libraries listed below

• vllm-project / vllm-nccl
  Manages vllm-nccl dependency
  ☆17Updated last year
• zartbot / stock_analyzer
  ☆21Updated 6 months ago
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆131Updated 4 months ago
• inclusionAI / asystem-awex
  A high-performance RL training-inference weight synchronization framework, designed to enable second-level parameter updates from trainin…
  ☆129Updated last month
• Oneflow-Inc / serving
  OneFlow Serving
  ☆20Updated 9 months ago
• HFAiLab / hai-platform-studio
  配合 HAI Platform 使用的集成化用户界面
  ☆53Updated 2 years ago
• zhaochenyang20 / ModelServer
  Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang
  ☆61Updated last year
• rayleizhu / vllm-ra
  [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts
  ☆40Updated last year
• tensorchord / deepseek-api-arena
  A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.
  ☆30Updated 10 months ago
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆83Updated 11 months ago
• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆28Updated 2 years ago
• thunlp / APB
  Official Implementation of APB (ACL 2025 main Oral)
  ☆32Updated 11 months ago
• tensorchord / modelz-ChatGLM
  Deploy ChatGLM on Modelz
  ☆16Updated 2 years ago
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆40Updated 2 years ago
• inferflow / inferflow
  Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
  ☆251Updated last year
• zenrran4nlp / Awesome-LLM-Inference-Serving
  ☆47Updated 9 months ago
• tyler-griggs / melange-release
  ☆48Updated last year
• llm-semantic-router / vllm-router
  vLLM Router
  ☆54Updated last year
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆38Updated 9 months ago
• thunlp / Delta-CoMe
  Delta-CoMe can achieve near loss-less 1-bit compressin which has been accepted by NeurIPS 2024
  ☆58Updated last year
• sgl-project / sgl-cookbook
  Cookbook of SGLang - Recipe
  ☆63Updated this week
• OpenSQZ / MegatronApp
  Toolchain built around the Megatron-LM for Distributed Training
  ☆84Updated last month
• Gaffey / ExCP
  Official implementation of ICML 2024 paper "ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinking".
  ☆47Updated last year
• bentoml / llm-bench
  ☆56Updated last year
• Qihoo360 / dgl-operator
  The DGL Operator makes it easy to run Deep Graph Library (DGL) graph neural network training on Kubernetes
  ☆44Updated 4 years ago
• ModelTC / awesome-lm-system
  Summary of system papers/frameworks/codes/tools on training or serving large model
  ☆57Updated 2 years ago
• simon-mo / vLLM-Benchmark
  ☆31Updated 9 months ago
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆50Updated this week
• JerryYin777 / PaperHelper
  PaperHelper: Knowledge-Based LLM QA Paper Reading Assistant with Reliable References
  ☆20Updated last year
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆139Updated last year