DeepRec-AI / extension

Related projects ⓘ

Alternatives and complementary repositories for extension

• volcengine / veGiantModel
  ☆208Updated last year
• alibaba / EasyParallelLibrary
  Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
  ☆264Updated last year
• pcg-mlp / KsanaLLM
  ☆282Updated last week
• alibaba / rtp-llm
  RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
  ☆541Updated 3 weeks ago
• DeepRec-AI / HybridBackend
  A high-performance framework for training wide-and-deep recommender systems on heterogeneous cluster
  ☆156Updated 6 months ago
• alibaba / TePDist
  TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.
  ☆90Updated last year
• intelligent-machine-learning / glake
  GLake: optimizing GPU memory management and IO transmission.
  ☆375Updated 3 months ago
• FlagOpen / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆167Updated this week
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆135Updated 2 months ago
• baidu / puck
  Puck is a high-performance ANN search engine
  ☆340Updated 5 months ago
• Oneflow-Inc / DLPerf
  DeepLearning Framework Performance Profiling Toolkit
  ☆278Updated 2 years ago
• Ascend / AscendSpeed
  ☆74Updated 10 months ago
• bytedance / primus
  ☆197Updated last year
• DeepRec-AI / serving
  A high-performance serving system for DeepRec based on TensorFlow Serving.
  ☆18Updated 11 months ago
• bytedance / ByteTransformer
  optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052
  ☆457Updated 7 months ago
• THUDM / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆39Updated last year
• OpenPPL / ppl.llm.serving
  ☆123Updated this week
• alibaba / Megatron-LLaMA
  Best practice for training LLaMA models in Megatron-LM
  ☆627Updated 10 months ago
• wuba / dl_inference
  通用深度学习推理工具，可在生产环境中快速上线由TensorFlow、PyTorch、Caffe框架训练出的深度学习模型。
  ☆406Updated 2 years ago
• Qihoo360 / tensornet
  ☆318Updated 2 weeks ago
• tengkz / tensorflow_notes
  tensorflow源码阅读笔记
  ☆189Updated 6 years ago
• void-main / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆60Updated last year
• ninehills / llm-inference-benchmark
  LLM Inference benchmark
  ☆349Updated 3 months ago
• Oneflow-Inc / models
  Models and examples built with OneFlow
  ☆96Updated 3 weeks ago
• FlagOpen / FlagPerf
  FlagPerf is an open-source software platform for benchmarking AI chips.
  ☆311Updated this week
• PaddlePaddle / ElasticCTR
  ElasticCTR，即飞桨弹性计算推荐系统，是基于Kubernetes的企业级推荐系统开源解决方案。该方案融合了百度业务场景下持续打磨的高精度CTR模型、飞桨开源框架的大规模分布式训练能力、工业级稀疏参数弹性调度服务，帮助用户在Kubernetes环境中一键完成推荐系统部…
  ☆180Updated 4 years ago
• alibaba / BladeDISC
  BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.
  ☆815Updated 2 months ago
• mindspore-lab / mindformers
  ☆142Updated this week
• Tencent / embedx
  embedx 是基于 c++ 开发的、完全自研的分布式 embedding 训练和推理框架。它目前支持 图模型、深度排序、召回模型和图与排序、图与召回的联合训练模型等
  ☆300Updated 5 months ago
• DeepRec-AI / DeepRec
  DeepRec is a high-performance recommendation deep learning framework based on TensorFlow. It is hosted in incubation in LF AI & Data Foun…
  ☆1,046Updated 4 months ago