leo811121 / UIUC-CS-483-Parallel-Programming

Related projects: ⓘ

• Deep-Learning-Profiling-Tools / triton-viz
  ☆124Updated last week
• cuda-mode / triton-index
  Cataloging released Triton kernels.
  ☆111Updated 3 weeks ago
• cuda-mode / ring-attention
  ring-attention experiments
  ☆89Updated 5 months ago
• cuda-mode / profiling-cuda-in-torch
  ☆124Updated 7 months ago
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆48Updated 2 weeks ago
• unixpickle / learn-ptx
  Learning about CUDA by writing PTX code.
  ☆28Updated 6 months ago
• siboehm / ShallowSpeed
  Small scale distributed training of sequential deep learning models, built on Numpy and MPI.
  ☆88Updated 11 months ago
• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆29Updated last month
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆123Updated last month
• stanford-futuredata / stk
  ☆83Updated 3 weeks ago
• interestingLSY / swiftLLM
  A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …
  ☆84Updated 2 months ago
• YconquestY / Needle
  Imperative deep learning framework with customized GPU and CPU backend
  ☆28Updated last year
• gau-nernst / learn-cuda
  Learn CUDA with PyTorch
  ☆11Updated last month
• pytorch-labs / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆210Updated last month
• DS3Lab / CocktailSGD
  ☆24Updated last year
• dshah3 / GPU-Puzzles
  Solve puzzles. Learn CUDA.
  ☆53Updated 9 months ago
• openmlsys / openmlsys-en
  《Machine Learning Systems: Design and Implementation》- English Version
  ☆16Updated 8 months ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆58Updated 6 months ago
• softmax1 / Flash-Attention-Softmax-N
  CUDA and Triton implementations of Flash Attention with SoftmaxN.
  ☆66Updated 3 months ago
• thecharlieblake / lovely-llama
  An implementation of the Llama architecture, to instruct and delight
  ☆21Updated last month
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆56Updated 9 months ago
• opengear-project / GEAR
  GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM
  ☆134Updated 2 months ago
• dlsyscourse / hw0
  ☆21Updated 4 months ago
• NVIDIA / Megatron-Energon
  Megatron's multi-modal data loader
  ☆42Updated this week
• FasterDecoding / TEAL
  ☆75Updated this week
• lucidrains / pytorch-custom-utils
  Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…
  ☆115Updated last month
• cloneofsimo / min-fsdp
  ☆68Updated 2 months ago
• efeslab / Atom
  [MLSys'24] Atom: Low-bit Quantization for Efficient and Accurate LLM Serving
  ☆258Updated 2 months ago
• linjames0 / Transformer-CUDA
  An implementation of the transformer architecture onto an Nvidia CUDA kernel
  ☆152Updated 11 months ago
• HanGuo97 / flute
  Fast Matrix Multiplications for Lookup Table-Quantized LLMs
  ☆156Updated this week