HFAiLab / hai-platform

Related projects ⓘ

Alternatives and complementary repositories for hai-platform

• alibaba / EasyParallelLibrary
  Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
  ☆263Updated last year
• intelligent-machine-learning / glake
  GLake: optimizing GPU memory management and IO transmission.
  ☆379Updated 3 months ago
• pcg-mlp / KsanaLLM
  ☆289Updated this week
• virtaitech / orion
  ☆269Updated last year
• volcengine / veGiantModel
  ☆209Updated last year
• alibaba / rtp-llm
  RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
  ☆545Updated last month
• ninehills / llm-inference-benchmark
  LLM Inference benchmark
  ☆350Updated 3 months ago
• 4paradigm / k8s-vgpu-scheduler
  OpenAIOS vGPU device plugin for Kubernetes is originated from the OpenAIOS project to virtualize GPU device memory, in order to allow app…
  ☆523Updated 6 months ago
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆137Updated 2 months ago
• FlagOpen / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆169Updated this week
• OpenPPL / ppl.llm.serving
  ☆123Updated 2 weeks ago
• mindspore-lab / mindformers
  ☆144Updated this week
• FlagOpen / FlagPerf
  FlagPerf is an open-source software platform for benchmarking AI chips.
  ☆313Updated this week
• kvcache-ai / Mooncake
  Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
  ☆1,120Updated 3 months ago
• bytedance / primus
  ☆197Updated last year
• tkestack / vcuda-controller
  ☆504Updated 5 months ago
• shikanon / kubeflow-manifests
  kubeflow国内一键安装文件
  ☆342Updated 2 years ago
• THUDM / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆39Updated last year
• zw0610 / zw0610.github.io
  ☆55Updated 4 years ago
• Ascend / AscendSpeed
  ☆74Updated 11 months ago
• Oneflow-Inc / libai
  LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
  ☆390Updated this week
• bytedance / ByteTransformer
  optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052
  ☆457Updated 8 months ago
• hpcaitech / SwiftInfer
  Efficient AI Inference & Serving
  ☆458Updated 10 months ago
• 01-ai / Descartes
  ☆100Updated 7 months ago
• volcengine / ml-platform-sdk-python
  ☆30Updated last year
• alibaba / ChatLearn
  A flexible and efficient training framework for large-scale alignment tasks
  ☆206Updated this week
• alibaba / TePDist
  TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.
  ☆90Updated last year
• NascentCore / llm-numbers-cn
  中文版 llm-numbers
  ☆108Updated 10 months ago
• OpenPPL / ppl.nn.llm
  ☆140Updated 6 months ago
• PaddlePaddle / PaddleFlow
  ☆114Updated last week