intelligent-machine-learning / dlrover

Related projects ⓘ

Alternatives and complementary repositories for dlrover

• alibaba / Pai-Megatron-Patch
  The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.
  ☆721Updated this week
• intelligent-machine-learning / glake
  GLake: optimizing GPU memory management and IO transmission.
  ☆379Updated 3 months ago
• kvcache-ai / Mooncake
  Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
  ☆1,120Updated 3 months ago
• alibaba / rtp-llm
  RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
  ☆545Updated last month
• volcengine / veScale
  A PyTorch Native LLM Training Framework
  ☆665Updated 2 months ago
• FlagOpen / FlagPerf
  FlagPerf is an open-source software platform for benchmarking AI chips.
  ☆313Updated this week
• alibaba / Megatron-LLaMA
  Best practice for training LLaMA models in Megatron-LM
  ☆628Updated 10 months ago
• Jack47 / hack-SysML
  The road to hack SysML and become an system expert
  ☆437Updated last month
• pcg-mlp / KsanaLLM
  ☆289Updated this week
• alibaba / EasyParallelLibrary
  Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
  ☆263Updated last year
• FlagOpen / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆169Updated this week
• HFAiLab / hai-platform
  一种任务级GPU算力分时调度的高性能深度学习训练平台
  ☆311Updated last year
• bytedance / ByteTransformer
  optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052
  ☆457Updated 8 months ago
• alipay / PainlessInferenceAcceleration
  ☆290Updated 4 months ago
• microsoft / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,893Updated last month
• LLMServe / DistServe
  Disaggregated serving system for Large Language Models (LLMs).
  ☆359Updated 3 months ago
• volcengine / verl
  veRL: Volcano Engine Reinforcement Learning for LLM
  ☆318Updated this week
• OpenBMB / BMTrain
  Efficient Training (including pre-training and fine-tuning) for Big Models
  ☆564Updated 3 months ago
• DefTruth / CUDA-Learn-Notes
  📚Modern CUDA Learn Notes with PyTorch: Tensor/CUDA Cores, 📖150+ CUDA Kernels with PyTorch bindings, 📖HGEMM/SGEMM (95%~99% cuBLAS perfo…
  ☆1,473Updated this week
• Oneflow-Inc / libai
  LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
  ☆390Updated this week
• flashinfer-ai / flashinfer
  FlashInfer: Kernel Library for LLM Serving
  ☆1,452Updated this week
• ninehills / llm-inference-benchmark
  LLM Inference benchmark
  ☆350Updated 3 months ago
• intel / xFasterTransformer
  ☆379Updated last week
• mindspore-lab / mindformers
  ☆144Updated this week
• hpcaitech / SwiftInfer
  Efficient AI Inference & Serving
  ☆458Updated 10 months ago
• bytedance / primus
  ☆197Updated last year
• AmberLJC / LLMSys-PaperList
  Large Language Model (LLM) Systems Paper List
  ☆645Updated this week
• BBuf / how-to-optim-algorithm-in-cuda
  how to optimize some algorithm in cuda.
  ☆1,593Updated last week
• PaddlePaddle / PaddleFlow
  ☆114Updated last week
• volcengine / veGiantModel
  ☆209Updated last year