YconquestY / Needle

Related projects: ⓘ

• 66RING / tiny-flash-attention
  flash attention tutorial written in python, triton, cuda, cutlass
  ☆159Updated 3 months ago
• galeselee / Awesome_LLM_System-PaperList
  Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…
  ☆153Updated this week
• mit-han-lab / parallel-computing-tutorial
  ☆134Updated last year
• openmlsys / openmlsys-cuda
  Tutorials for writing high-performance GPU operators in AI frameworks.
  ☆118Updated last year
• KnowingNothing / MatmulTutorial
  A Easy-to-understand TensorOp Matmul Tutorial
  ☆265Updated this week
• LLMServe / SwiftTransformer
  High performance Transformer implementation in C++.
  ☆67Updated this week
• nvixnu / pmpp__programming_massively_parallel_processors
  Examples and exercises from the book Programming Massively Parallel Processors - A Hands-on Approach. David B. Kirk and Wen-mei W. Hwu (T…
  ☆33Updated 3 years ago
• eedalong / ECE408
  Code base and slides for ECE408：Applied Parallel Programming On GPU.
  ☆113Updated 3 years ago
• ifromeast / cuda_learning
  learning how CUDA works
  ☆150Updated last month
• dlsyscourse / hw0
  ☆21Updated 4 months ago
• leimao / CUDA-GEMM-Optimization
  CUDA Matrix Multiplication Optimization
  ☆118Updated 2 months ago
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆48Updated 2 weeks ago
• microsoft / sarathi-serve
  A low-latency & high-throughput serving engine for LLMs
  ☆174Updated last week
• microsoft / vattention
  Dynamic Memory Management for Serving LLMs without PagedAttention
  ☆186Updated last month
• AlibabaPAI / FLASHNN
  ☆67Updated last week
• chenhongyu2048 / LLM-inference-optimization-paper
  Summary of some awesome work for optimizing LLM inference
  ☆26Updated this week
• mlc-ai / notebooks
  ☆188Updated last week
• interestingLSY / swiftLLM
  A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …
  ☆84Updated 2 months ago
• Bruce-Lee-LY / flash_attention_inference
  Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
  ☆20Updated last week
• interestingLSY / CUDA-From-Correctness-To-Performance-Code
  Codes & examples for "CUDA - From Correctness to Performance"
  ☆45Updated 2 weeks ago
• ColfaxResearch / cutlass-kernels
  ☆138Updated 2 months ago
• cuda-mode / ring-attention
  ring-attention experiments
  ☆89Updated 5 months ago
• cuda-mode / triton-index
  Cataloging released Triton kernels.
  ☆111Updated 3 weeks ago
• Sunt-ing / stick
  A PyTorch-like deep learning framework. Just for fun.
  ☆128Updated 11 months ago
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆173Updated 3 months ago
• PKUFlyingPig / CMU10-714
  Learning material for CMU10-714: Deep Learning System
  ☆201Updated 4 months ago
• yifanlu0227 / MIT-6.5940
  All Homeworks for TinyML and Efficient Deep Learning Computing 6.5940 • Fall • 2023 • https://efficientml.ai
  ☆108Updated 9 months ago
• madsys-dev / deepseekv2-profile
  ☆60Updated last month
• alibaba / easydist
  Automated Parallelization System and Infrastructure for Multiple Ecosystems
  ☆70Updated last month
• Bruce-Lee-LY / cuda_hgemv
  Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.
  ☆40Updated last week