DeepRec-AI / extensionLinks
DeepRec Extension is an easy-to-use, stable and efficient large-scale distributed training system based on DeepRec.
☆11Updated last year
Alternatives and similar repositories for extension
Users that are interested in extension are comparing it to the libraries listed below
Sorting:
- ☆217Updated last year
- TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.☆94Updated 2 years ago
- Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.☆267Updated 2 years ago
- A high-performance framework for training wide-and-deep recommender systems on heterogeneous cluster☆158Updated last year
- A high-performance serving system for DeepRec based on TensorFlow Serving.☆18Updated last year
- RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.☆777Updated 3 weeks ago
- ☆332Updated 4 months ago
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆253Updated this week
- GLake: optimizing GPU memory management and IO transmission.☆463Updated 2 months ago
- ☆210Updated last year
- FlagScale is a large model toolkit based on open-sourced projects.☆280Updated this week
- Puck is a high-performance ANN search engine☆357Updated last week
- HierarchicalKV is a part of NVIDIA Merlin and provides hierarchical key-value storage to meet RecSys requirements. The key capability of…☆146Updated last week
- ElasticCTR，即飞桨弹性计算推荐系统，是基于Kubernetes的企业级推荐系统开源解决方案。该方案融合了百度业务场景下持续打磨的高精度CTR模型、飞桨开源框架的大规模分布式训练能力、工业级稀疏参数弹性调度服务，帮助用户在Kubernetes环境中一键完成推荐系统部…☆183Updated 4 years ago
- Compare different hardware platforms via the Roofline Model for LLM inference tasks.☆100Updated last year
- ☆166Updated this week
- ☆127Updated 5 months ago
- TLLM_QMM strips the implementation of quantized kernels of Nvidia's TensorRT-LLM, removing NVInfer dependency and exposes ease of use Pyt…☆16Updated 10 months ago
- ☆45Updated last year
- A CLI for Kubeflow.☆60Updated last year
- PyTorch distributed training acceleration framework☆49Updated 3 months ago
- Transformer related optimization, including BERT, GPT☆39Updated 2 years ago
- DeepLearning Framework Performance Profiling Toolkit☆285Updated 3 years ago
- 配合 HAI Platform 使用的集成化用户界面☆51Updated 2 years ago
- Transformer related optimization, including BERT, GPT☆59Updated last year
- ☆108Updated last year
- LLM Inference benchmark☆419Updated 10 months ago
- ☆148Updated 4 months ago
- vLLM Documentation in Chinese Simplified / vLLM 中文文档☆75Updated 2 weeks ago
- ☆79Updated last year