Alternatives and similar repositories for AI-fundermentals:

Users that are interested in AI-fundermentals are comparing it to the libraries listed below

• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆91Updated 10 months ago
• AlibabaPAI / llumnix
  Efficient and easy multi-instance LLM serving
  ☆284Updated last week
• FlagOpen / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆209Updated this week
• antgroup / glake
  GLake: optimizing GPU memory management and IO transmission.
  ☆424Updated 2 months ago
• Bruce-Lee-LY / cuda_hook
  Hooked CUDA-related dynamic libraries by using automated code generation tools.
  ☆145Updated last year
• Project-HAMi / HAMi-core
  HAMi-core compiles libvgpu.so, which ensures hard limit on GPU in container
  ☆131Updated this week
• Project-HAMi / volcano-vgpu-device-plugin
  Device-plugin for volcano vgpu which support hard resource isolation
  ☆58Updated 3 weeks ago
• zw0610 / zw0610.github.io
  ☆57Updated 4 years ago
• pokerfaceSad / GPUMounter
  A kubernetes plugin which enables dynamically add or remove GPU resources for a running Pod
  ☆122Updated 2 years ago
• leptonai / gpud
  GPUd automates monitoring, diagnostics, and issue identification for GPUs
  ☆270Updated this week
• LLMServe / DistServe
  Disaggregated serving system for Large Language Models (LLMs).
  ☆453Updated 5 months ago
• PaddlePaddle / PaddleFlow
  ☆119Updated 2 months ago
• MLSys-Learner-Resources / Awesome-MLSys-Blogger
  The repository has collected a batch of noteworthy MLSys bloggers (Algorithms/Systems)
  ☆153Updated 3 weeks ago
• AliyunContainerService / et-operator
  Kubernetes Operator for AI and Bigdata Elastic Training
  ☆85Updated 2 weeks ago
• coreweave / nccl-tests
  NVIDIA NCCL Tests for Distributed Training
  ☆78Updated this week
• alibaba / GPU-scheduler-for-deep-learning
  GPU-scheduler-for-deep-learning
  ☆201Updated 4 years ago
• kubedl-io / morphling
  Automatic tuning for ML model deployment on Kubernetes
  ☆80Updated 2 months ago
• mental2008 / awesome-papers
  Here are my personal paper reading notes (including cloud computing, resource management, systems, machine learning, deep learning, and o…
  ☆65Updated this week
• houminz / paper-reading
  Paper Reading：涉及分布式、虚拟化、网络、机器学习
  ☆23Updated 4 years ago
• AlibabaPAI / torchacc
  PyTorch distributed training acceleration framework
  ☆39Updated last week
• CalvinXKY / BasicCUDA
  A tutorial for CUDA&PyTorch
  ☆126Updated last week
• Mr-Linus / Yoda-Scheduler
  Yoda is a kubernetes scheduler based on GPU metrics. Yoda是一个基于GPU参数指标的 Kubernetes 调度器
  ☆141Updated 2 years ago
• LLMServe / SwiftTransformer
  High performance Transformer implementation in C++.
  ☆99Updated last week
• chenhongyu2048 / LLM-inference-optimization-paper
  Summary of some awesome work for optimizing LLM inference
  ☆51Updated last month
• alibaba / TePDist
  TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.
  ☆90Updated last year
• DefTruth / hgemm-tensorcores-mma
  ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.
  ☆47Updated this week
• volcano-sh / devices
  Device plugins for Volcano, e.g. GPU
  ☆113Updated 4 months ago
• galeselee / Awesome_LLM_System-PaperList
  Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…
  ☆213Updated last month
• PaddleJitLab / CUDATutorial
  A self-learning tutorail for CUDA High Performance Programing.
  ☆337Updated last month
• harleyszhang / llm_counts
  llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
  ☆76Updated 3 weeks ago