RussWong / LLM-engineeringLinks
☆26Updated last month
Alternatives and similar repositories for LLM-engineering
Users that are interested in LLM-engineering are comparing it to the libraries listed below
Sorting:
- A CUDA tutorial to make people learn CUDA program from 0☆251Updated last year
- A light llama-like llm inference framework based on the triton kernel.☆153Updated last week
- ☆139Updated last year
- Examples of CUDA implementations by Cutlass CuTe☆236Updated 3 months ago
- learning how CUDA works☆323Updated 7 months ago
- A tutorial for CUDA&PyTorch☆156Updated 8 months ago
- This project is about convolution operator optimization on GPU, include GEMM based (Implicit GEMM) convolution.☆39Updated this week
- ☆135Updated 9 months ago
- ☆150Updated 8 months ago
- Optimizing SGEMM kernel functions on NVIDIA GPUs to a close-to-cuBLAS performance.☆384Updated 9 months ago
- 使用 CUDA C++ 实现的 llama 模型推理框架☆62Updated 10 months ago
- how to learn PyTorch and OneFlow☆455Updated last year
- A Easy-to-understand TensorOp Matmul Tutorial☆378Updated last year
- A simple high performance CUDA GEMM implementation.☆406Updated last year
- ☆153Updated 9 months ago
- ☆36Updated 4 months ago
- ☆257Updated this week
- Yinghan's Code Sample☆350Updated 3 years ago
- ☆106Updated 4 months ago
- ☆69Updated 8 months ago
- ☆109Updated 6 months ago
- llm theoretical performance analysis tools and support params, flops, memory and latency analysis.☆108Updated 2 months ago
- ☆115Updated last year
- flash attention tutorial written in python, triton, cuda, cutlass☆425Updated 4 months ago
- hands on model tuning with TVM and profile it on a Mac M1, x86 CPU, and GTX-1080 GPU.☆50Updated 2 years ago
- Machine Learning Compiler Road Map☆44Updated 2 years ago
- Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruct…☆480Updated last year
- Optimize softmax in triton in many cases☆21Updated last year
- code reading for tvm☆76Updated 3 years ago
- ☆59Updated 10 months ago