cr7258 / ai-infra-learningLinks
This repository organizes materials, recordings, and schedules related to AI-infra learning meetings.
☆130Updated this week
Alternatives and similar repositories for ai-infra-learning
Users that are interested in ai-infra-learning are comparing it to the libraries listed below
Sorting:
- learning how CUDA works☆317Updated 6 months ago
- 校招、秋招、春招、实习好项目,带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。☆420Updated 2 months ago
- A self-learning tutorail for CUDA High Performance Programing.☆733Updated 2 months ago
- The repository has collected a batch of noteworthy MLSys bloggers (Algorithms/Systems)☆272Updated 8 months ago
- A light llama-like llm inference framework based on the triton kernel.☆150Updated last month
- CUDA 算子手撕与面试指南☆579Updated 2 weeks ago
- how to learn PyTorch and OneFlow☆451Updated last year
- my cs notes☆54Updated 10 months ago
- llm theoretical performance analysis tools and support params, flops, memory and latency analysis.☆105Updated 2 months ago
- A CUDA tutorial to make people learn CUDA program from 0☆251Updated last year
- easy cuda code☆82Updated 8 months ago
- Codes & examples for "CUDA - From Correctness to Performance"☆107Updated 10 months ago
- ☆35Updated 4 months ago
- ☆295Updated 11 months ago
- 先进编译实验室的个人主页☆139Updated 4 months ago
- Puzzles for learning Triton, play it with minimal environment configuration!☆504Updated 9 months ago
- LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.☆818Updated last week
- 高性能计算相关知识学习笔记,包含学习笔记和相关知识的代码demo,在持续完善中。 如果有帮助的话请Star一下,对作者帮助很大,谢谢!☆445Updated 2 years ago
- UltraScale Playbook 中文版☆73Updated 5 months ago
- Disaggregated serving system for Large Language Models (LLMs).☆685Updated 5 months ago
- 📚200+ Tensor/CUDA Cores Kernels, ⚡️flash-attn-mma, ⚡️hgemm with WMMA, MMA and CuTe (98%~100% TFLOPS of cuBLAS/FA2 🎉🎉).☆42Updated 4 months ago
- Summary of some awesome work for optimizing LLM inference☆104Updated 3 months ago
- Curated collection of papers in MoE model inference☆255Updated last month
- A PyTorch-like deep learning framework. Just for fun.☆156Updated last year
- This repo is used for archiving my notes, codes and materials of cs learning.☆51Updated this week
- Materials for learning SGLang☆562Updated last week
- some hpc project for learning☆24Updated last year
- Examples of CUDA implementations by Cutlass CuTe☆229Updated 2 months ago
- Analyze the inference of Large Language Models (LLMs). Analyze aspects like computation, storage, transmission, and hardware roofline mod…☆547Updated last year
- ☆26Updated last month