DeepLink-org / DeepTraceLinks
DeepTrace: A lightweight, scalable real-time diagnostic and analysis tool for distributed training tasks.
☆17Updated last month
Alternatives and similar repositories for DeepTrace
Users that are interested in DeepTrace are comparing it to the libraries listed below
Sorting:
- vLLM Router☆51Updated last year
- A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.☆30Updated 8 months ago
- 国产加速卡-海光DCU实战(大模型 训练、微调、推理 等)☆60Updated 4 months ago
- Manages vllm-nccl dependency☆17Updated last year
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆131Updated 2 months ago
- Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang☆61Updated last year
- OneFlow Serving☆20Updated 8 months ago
- Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];☆41Updated last year
- Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…☆22Updated 7 months ago
- Delta-CoMe can achieve near loss-less 1-bit compressin which has been accepted by NeurIPS 2024☆59Updated last year
- patches for huggingface transformers to save memory☆32Updated 6 months ago
- Official Implementation of APB (ACL 2025 main Oral)☆32Updated 9 months ago
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆137Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆16Updated last year
- ☆46Updated 7 months ago
- ☆21Updated 4 months ago
- [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts☆40Updated last year
- A minimalist benchmarking tool designed to test the routine-generation capabilities of LLMs.☆27Updated last year
- Toolchain built around the Megatron-LM for Distributed Training☆79Updated last week
- ☆56Updated last year
- vLLM adapter for a TGIS-compatible gRPC server.☆45Updated this week
- A high-performance RL training-inference weight synchronization framework, designed to enable second-level parameter updates from trainin…☆109Updated last week
- An industrial extension library of pytorch to accelerate large scale model training☆55Updated 4 months ago
- ☆74Updated 6 months ago
- ☆123Updated 9 months ago
- XVERSE-MoE-A4.2B: A multilingual large language model developed by XVERSE Technology Inc.☆39Updated last year
- Deploy ChatGLM on Modelz☆16Updated 2 years ago
- Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).☆250Updated last year
- llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…☆89Updated last year
- ☆79Updated 2 years ago