DeepRec-AI / extension
DeepRec Extension is an easy-to-use, stable and efficient large-scale distributed training system based on DeepRec.
☆10Updated 9 months ago
Alternatives and similar repositories for extension:
Users that are interested in extension are comparing it to the libraries listed below
- RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.☆627Updated 3 weeks ago
- Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.☆266Updated last year
- ☆213Updated last year
- ☆314Updated 3 weeks ago
- Puck is a high-performance ANN search engine☆345Updated 2 months ago
- A high-performance framework for training wide-and-deep recommender systems on heterogeneous cluster☆157Updated 9 months ago
- TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.☆90Updated last year
- ☆388Updated last year
- A high-performance serving system for DeepRec based on TensorFlow Serving.☆18Updated last year
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆230Updated this week
- ☆152Updated this week
- ☆45Updated 11 months ago
- GLake: optimizing GPU memory management and IO transmission.☆428Updated 2 months ago
- Best practice for training LLaMA models in Megatron-LM☆642Updated last year
- Transformer related optimization, including BERT, GPT☆39Updated 2 years ago
- LLM Inference benchmark☆391Updated 6 months ago
- ☆127Updated last month
- FlagScale is a large model toolkit based on open-sourced projects.☆219Updated this week
- ☆107Updated 10 months ago
- tensorflow extend framework☆13Updated 5 years ago
- Transformer related optimization, including BERT, GPT☆59Updated last year
- ☆76Updated last year
- ☆322Updated last week
- optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052☆469Updated 11 months ago
- Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).☆237Updated 11 months ago
- ElasticCTR，即飞桨弹性计算推荐系统，是基于Kubernetes的企业级推荐系统开源解决方案。该方案融合了百度业务场景下持续打磨的高精度CTR模型、飞桨开源框架的大规模分布式训练能力、工业级稀疏参数弹性调度服务，帮助用户在Kubernetes环境中一键完成推荐系统部…☆181Updated 4 years ago
- llama inference for tencentpretrain☆97Updated last year
- export llama to onnx☆112Updated last month
- Baichuan2代码的逐行解析版本，适合小白☆212Updated last year
- ☆201Updated last year