AlibabaPAI / FlashModels

Related projects ⓘ

Alternatives and complementary repositories for FlashModels

• AlibabaPAI / torchacc
  PyTorch distributed training acceleration framework
  ☆34Updated this week
• ConnollyLeon / awesome-Auto-Parallelism
  A baseline repository of Auto-Parallelism in Training Neural Networks
  ☆141Updated 2 years ago
• parasailteam / coconet
  ☆73Updated last year
• microsoft / nnscaler
  nnScaler: Compiling DNN models for Parallel Training
  ☆77Updated 3 weeks ago
• microsoft / vattention
  Dynamic Memory Management for Serving LLMs without PagedAttention
  ☆240Updated last week
• bytedance / flux
  A fast communication-overlapping library for tensor parallelism on GPUs.
  ☆226Updated 3 weeks ago
• kwai / Megatron-Kwai
  [USENIX ATC '24] Accelerating the Training of Large Language Models using Efficient Activation Rematerialization and Optimal Hybrid Paral…
  ☆46Updated 3 months ago
• alibaba / TePDist
  TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.
  ☆90Updated last year
• eniac / paella
  Paella: Low-latency Model Serving with Virtualized GPU Scheduling
  ☆57Updated 6 months ago
• Cambricon / triton-linalg
  Development repository for the Triton-Linalg conversion
  ☆151Updated last month
• reed-lau / cute-gemm
  ☆79Updated 8 months ago
• DeepLink-org / DIOPI
  ☆68Updated last week
• UofT-EcoSystem / hotline
  ☆31Updated last year
• DeepLink-org / DLOP-Bench
  A benchmark suited especially for deep learning operators
  ☆41Updated last year
• OpenPPL / ppl.llm.kernel.cuda
  ☆138Updated 2 weeks ago
• microsoft / mscclpp
  MSCCL++: A GPU-driven communication stack for scalable AI applications
  ☆250Updated this week
• KnowingNothing / MatmulTutorial
  A Easy-to-understand TensorOp Matmul Tutorial
  ☆294Updated 2 months ago
• AlibabaPAI / llumnix
  Efficient and easy multi-instance LLM serving
  ☆219Updated this week
• ColfaxResearch / cutlass-kernels
  ☆169Updated 4 months ago
• LLMServe / SwiftTransformer
  High performance Transformer implementation in C++.
  ☆83Updated 2 months ago
• alibaba / llm-scheduling-artifact
  Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“
  ☆57Updated 5 months ago
• thu-pacman / PET
  PET: Optimizing Tensor Programs with Partially Equivalent Transformations and Automated Corrections
  ☆114Updated 2 years ago
• SJTU-IPADS / ugache
  ☆23Updated last year
• TiledTensor / TiledCUDA
  TiledCUDA is a highly efficient kernel template library designed to elevate CUDA C’s level of abstraction for processing tiles.
  ☆157Updated this week
• byungsoo-oh / ml-systems-papers
  Curated collection of papers in machine learning systems
  ☆167Updated last month
• Yinghan-Li / YHs_Sample
  Yinghan's Code Sample
  ☆289Updated 2 years ago
• zhuohan123 / terapipe
  ☆66Updated 3 years ago
• intelligent-machine-learning / glake
  GLake: optimizing GPU memory management and IO transmission.
  ☆381Updated 3 months ago
• lambda7xx / awesome-AI-system
  paper and its code for AI System
  ☆216Updated 2 months ago
• NVIDIA-Merlin / HierarchicalKV
  HierarchicalKV is a part of NVIDIA Merlin and provides hierarchical key-value storage to meet RecSys requirements. The key capability of…
  ☆133Updated 2 months ago