ASC-Competition / ASC24-LLM-inference-optimization
The dataset and baseline code for ASC23 LLM inference optimization challenge.
☆32Updated 10 months ago
Related projects ⓘ
Alternatives and complementary repositories for ASC24-LLM-inference-optimization
- OpenCAEPoro for ASC 2024☆34Updated 10 months ago
- Wiki fo HPC☆84Updated 10 months ago
- The Zaychik Power Controller server☆13Updated 6 months ago
- Repository for HPCGame 1st Problems.☆53Updated 9 months ago
- Codes & examples for "CUDA - From Correctness to Performance"☆67Updated 2 weeks ago
- 【2024年新版】国科大 陈云霁 智能计算系统AICS实验代码☆171Updated 5 months ago
- A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …☆98Updated 4 months ago
- A PyTorch-like deep learning framework. Just for fun.☆134Updated last year
- This repository is established to store personal notes and annotated papers during daily research.☆86Updated this week
- Documentation for HPC course☆135Updated 5 months ago
- 智能计算系统 AI Computing Systems 陈云霁☆123Updated last year
- ☆82Updated 5 months ago
- Learning material for CMU10-714: Deep Learning System☆214Updated 5 months ago
- Homework solutions for CMU 10-414/714 – Deep Learning Systems: Algorithms and Implementation☆41Updated last year
- ☆12Updated 7 months ago
- ☆70Updated last week
- ☆42Updated last month
- InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)☆75Updated 4 months ago
- 中科大计算机学院部分课程的试卷☆54Updated 10 months ago
- High performance Transformer implementation in C++.☆78Updated last month
- Summary of some awesome work for optimizing LLM inference☆34Updated this week
- Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…☆166Updated this week
- Documentation for YatCPU☆47Updated 11 months ago
- HPC-Lab for High Performance Computing course, 2023 Spring , Tsinghua Universit. 高性能计算导论 @ THU.☆18Updated last year
- ☆51Updated last month
- paper and its code for AI System☆210Updated 2 months ago
- ☆47Updated 11 months ago
- ☆20Updated last week
- Materials for learning SGLang☆75Updated this week
- learning how CUDA works☆162Updated 2 months ago