Alternatives and similar repositories for hack-SysML:

Users that are interested in hack-SysML are comparing it to the libraries listed below

• BBuf / how-to-learn-deep-learning-framework
  how to learn PyTorch and OneFlow
  ☆393Updated 10 months ago
• LLMServe / DistServe
  Disaggregated serving system for Large Language Models (LLMs).
  ☆468Updated 6 months ago
• lambda7xx / awesome-AI-system
  paper and its code for AI System
  ☆272Updated 3 weeks ago
• ConnollyLeon / awesome-Auto-Parallelism
  A baseline repository of Auto-Parallelism in Training Neural Networks
  ☆142Updated 2 years ago
• antgroup / glake
  GLake: optimizing GPU memory management and IO transmission.
  ☆431Updated 2 months ago
• mlc-ai / mlc-zh
  ☆598Updated 8 months ago
• pcg-mlp / KsanaLLM
  ☆314Updated last month
• FlagOpen / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆223Updated this week
• PaddleJitLab / CUDATutorial
  A self-learning tutorail for CUDA High Performance Programing.
  ☆369Updated 2 months ago
• PKU-DAIR / Hetu
  A high-performance distributed deep learning system targeting large-scale and automated distributed training.
  ☆284Updated last month
• Oneflow-Inc / DLPerf
  DeepLearning Framework Performance Profiling Toolkit
  ☆283Updated 2 years ago
• galeselee / Awesome_LLM_System-PaperList
  Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…
  ☆220Updated 2 months ago
• ifromeast / cuda_learning
  learning how CUDA works
  ☆201Updated 6 months ago
• bytedance / ByteTransformer
  optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052
  ☆469Updated 11 months ago
• volcengine / veScale
  A PyTorch Native LLM Training Framework
  ☆732Updated last month
• AmadeusChan / Awesome-LLM-System-Papers
  ☆538Updated 5 months ago
• MegEngine / MegCC
  MegCC是一个运行时超轻量，高效，移植简单的深度学习模型编译器
  ☆474Updated 3 months ago
• kwai / Megatron-Kwai
  [USENIX ATC '24] Accelerating the Training of Large Language Models using Efficient Activation Rematerialization and Optimal Hybrid Paral…
  ☆51Updated 6 months ago
• FlagOpen / FlagGems
  FlagGems is an operator library for large language models implemented in Triton Language.
  ☆421Updated this week
• microsoft / vattention
  Dynamic Memory Management for Serving LLMs without PagedAttention
  ☆290Updated this week
• MLSys-Learner-Resources / Awesome-MLSys-Blogger
  The repository has collected a batch of noteworthy MLSys bloggers (Algorithms/Systems)
  ☆179Updated last month
• Hsword / Hetu
  A high-performance distributed deep learning system targeting large-scale and automated distributed training. If you have any interests, …
  ☆107Updated last year
• CalvinXKY / BasicCUDA
  A tutorial for CUDA&PyTorch
  ☆126Updated last month
• Shenggan / awesome-distributed-ml
  A curated list of awesome projects and papers for distributed training or inference
  ☆216Updated 4 months ago
• OpenPPL / ppl.llm.serving
  ☆127Updated last month
• alibaba / rtp-llm
  RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
  ☆629Updated last month
• openmlsys / openmlsys-cuda
  Tutorials for writing high-performance GPU operators in AI frameworks.
  ☆129Updated last year
• alibaba / EasyParallelLibrary
  Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
  ☆266Updated last year
• bytedance / flux
  A fast communication-overlapping library for tensor parallelism on GPUs.
  ☆296Updated 3 months ago
• KnowingNothing / MatmulTutorial
  A Easy-to-understand TensorOp Matmul Tutorial
  ☆316Updated 5 months ago