FlyAIBox / dcu-in-actionLinks
国产加速卡-海光DCU实战(大模型训练、微调、推理 等)
☆46Updated last month
Alternatives and similar repositories for dcu-in-action
Users that are interested in dcu-in-action are comparing it to the libraries listed below
Sorting:
- Manages vllm-nccl dependency☆17Updated last year
- llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…☆86Updated last year
- Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang☆56Updated 10 months ago
- 配合 HAI Platform 使用的集成化用户界面☆53Updated 2 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆17Updated last year
- Delta-CoMe can achieve near loss-less 1-bit compressin which has been accepted by NeurIPS 2024☆57Updated 10 months ago
- CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge tec…☆192Updated this week
- A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.☆29Updated 5 months ago
- 官方transformers源码解析。AI大模型时代,pytorch、transformer是新操作系统,其他都是运行在其上面的软件。☆17Updated last year
- ☆24Updated last year
- Fused Qwen3 MoE layer for faster training, compatible with HF Transformers, LoRA, 4-bit quant, Unsloth☆176Updated this week
- Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.☆130Updated this week
- Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…☆22Updated 4 months ago
- DeepTrace: A lightweight, scalable real-time diagnostic and analysis tool for distributed training tasks.☆15Updated 2 weeks ago
- LLM 推理服务性能测试☆44Updated last year
- Tablestore for Agent Memory