chenzomi12 / aisystem-docsLinks
☆315Updated this week
Alternatives and similar repositories for aisystem-docs
Users that are interested in aisystem-docs are comparing it to the libraries listed below
Sorting:
- LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.☆774Updated last week
- 校招、秋招、春招、实习好项目,带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。☆358Updated 2 months ago
- A self-learning tutorail for CUDA High Performance Programing.☆635Updated last month
- AIInfra(AI 基础设施)指AI系统从底层芯片等硬件,到上层软件栈支持AI大模型训练和推理。☆2,739Updated last week
- Community maintained hardware plugin for vLLM on Ascend☆703Updated this week
- how to learn PyTorch and OneFlow☆431Updated last year
- 大模型/LLM推理和部署理论与实践☆266Updated 2 months ago
- A CUDA tutorial to make people learn CUDA program from 0☆231Updated 10 months ago
- learning how CUDA works☆263Updated 2 months ago
- RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.☆777Updated 2 weeks ago
- GLake: optimizing GPU memory management and IO transmission.☆463Updated 2 months ago
- CUDA 算子手撕与面试指南☆380Updated 4 months ago
- 模型压缩的小白入门教程☆281Updated 6 months ago
- CUDA C 编程权威指南代码实现 包含了书上第二章到第八章的大部分代码实现和作者笔记,全由作者本人手动实现,难免有错误的地方,请大家谨慎参考,非常欢迎对错误的指正。 如果有帮助的话请Star一下,对作者帮助很大,谢谢!☆339Updated 2 years ago
- Learning Large Language Model (LLM)(大语言模型学习)☆694Updated last month
- [EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a V…☆476Updated this week
- ☆332Updated 4 months ago
- LLM全栈优质资源汇总☆565Updated 6 months ago
- ☆274Updated 7 months ago
- A light llama-like llm inference framework based on the triton kernel.☆121Updated last week
- 《CUDA编程基础与实践》一书的代码☆122Updated 3 years ago
- LLM Inference benchmark☆419Updated 10 months ago
- My learning notes/codes for ML SYS.☆2,337Updated this week
- High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.☆1,129Updated this week
- ☆610Updated 10 months ago
- LLM101n: Let's build a Storyteller 中文版☆131Updated 9 months ago
- FlagGems is an operator library for large language models implemented in the Triton Language.☆546Updated this week
- 一种任务级GPU算力分时调度的高性能深度学习训练平台☆647Updated last year
- 高性能计算相关知识学习笔记,包含学习笔记和相关知识的代码demo,在持续完善中。 如果有帮助的话请Star一下,对作者帮助很大,谢谢!☆433Updated 2 years ago
- 看图学大模型☆302Updated 10 months ago