Alternatives and similar repositories for AI-fundermentals:

Users that are interested in AI-fundermentals are comparing it to the libraries listed below

• FlagOpen / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆268Updated this week
• antgroup / glake
  GLake: optimizing GPU memory management and IO transmission.
  ☆456Updated last month
• SJTU-IPADS / PhoenixOS
  Fast OS-level support for GPU checkpoint and restore
  ☆183Updated last week
• chenweiphd / DeepSeek-MoE-ResourceMap
  ☆129Updated 2 months ago
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆97Updated last year
• PaddleJitLab / CUDATutorial
  A self-learning tutorail for CUDA High Performance Programing.
  ☆599Updated last week
• leptonai / gpud
  GPUd automates monitoring, diagnostics, and issue identification for GPUs
  ☆347Updated this week
• AlibabaPAI / llumnix
  Efficient and easy multi-instance LLM serving
  ☆383Updated this week
• sgl-project / sgl-learning-materials
  Materials for learning SGLang
  ☆387Updated last month
• golfxiao / ScratchLLMStepByStep
  一个手把手教你从零开始编写GPT并训练大语言模型的教程
  ☆71Updated 3 months ago
• BBuf / how-to-learn-deep-learning-framework
  how to learn PyTorch and OneFlow
  ☆425Updated last year
• pcg-mlp / KsanaLLM
  ☆326Updated 3 months ago
• bytedance / InfiniStore
  KV cache store for distributed LLM inference
  ☆151Updated 3 weeks ago
• bytedance / byteir
  A model compilation solution for various hardware
  ☆427Updated this week
• AdvancedCompiler / AdvancedCompiler
  先进编译实验室的个人主页
  ☆66Updated 3 months ago
• frankwang0818 / AI_compiler_development_guide
  Free resource for the book AI Compiler Development Guide
  ☆43Updated 2 years ago
• hyperai / triton-cn
  Triton Documentation in Chinese Simplified / Triton 中文文档
  ☆66Updated last week
• harleyszhang / llm_note
  LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.
  ☆732Updated this week
• zjhellofss / KuiperLLama
  校招、秋招、春招、实习好项目，带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。
  ☆331Updated 3 weeks ago
• interestingLSY / CUDA-From-Correctness-To-Performance-Code
  Codes & examples for "CUDA - From Correctness to Performance"
  ☆96Updated 6 months ago
• InfiniTensor / InfiniTensor
  ☆235Updated 2 months ago
• pokerfaceSad / GPUMounter
  A kubernetes plugin which enables dynamically add or remove GPU resources for a running Pod
  ☆124Updated 3 years ago
• LearningInfiniTensor / TinyInfiniTensor
  ☆27Updated 3 months ago
• chenhongyu2048 / LLM-inference-optimization-paper
  Summary of some awesome work for optimizing LLM inference
  ☆69Updated last week
• pprp / ultrascale-playbook-zh
  UltraScale Playbook 中文版
  ☆35Updated last month
• harleyszhang / llm_counts
  llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
  ☆85Updated 3 months ago
• ninehills / llm-inference-benchmark
  LLM Inference benchmark
  ☆408Updated 9 months ago
• HFAiLab / hai-platform
  一种任务级GPU算力分时调度的高性能深度学习训练平台
  ☆634Updated last year
• bytedance-iaas / splitwise-demos
  ☆23Updated last month
• harleyszhang / lite_llama
  A light llama-like llm inference framework based on the triton kernel.
  ☆108Updated last week