stanford-cs149 / cs149gpt

Related projects ⓘ

Alternatives and complementary repositories for cs149gpt

• siboehm / ShallowSpeed
  Small scale distributed training of sequential deep learning models, built on Numpy and MPI.
  ☆107Updated last year
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆134Updated 2 months ago
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆68Updated 3 weeks ago
• mobiusml / gemlite
  Simple and fast low-bit matmul kernels in CUDA / Triton
  ☆145Updated this week
• cchan / tccl
  extensible collectives library in triton
  ☆72Updated last month
• gpu-mode / ring-attention
  ring-attention experiments
  ☆97Updated last month
• gpu-mode / profiling-cuda-in-torch
  ☆133Updated 9 months ago
• lessw2020 / triton_kernels_for_fun_and_profit
  Custom kernels in Triton language for accelerating LLMs
  ☆17Updated 7 months ago
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆166Updated 3 weeks ago
• gpu-mode / awesomeMLSys
  An ML Systems Onboarding list
  ☆547Updated last week
• Deep-Learning-Profiling-Tools / triton-viz
  ☆153Updated this week
• linjames0 / Transformer-CUDA
  An implementation of the transformer architecture onto an Nvidia CUDA kernel
  ☆157Updated last year
• yifuwang / symm-mem-recipes
  ☆12Updated last month
• gevtushenko / llm.c
  LLM training in simple, raw C/CUDA
  ☆86Updated 6 months ago
• gau-nernst / learn-cuda
  Learn CUDA with PyTorch
  ☆14Updated 2 weeks ago
• apoorvnandan / lilgrad
  pytorch from scratch in pure C/CUDA and python
  ☆37Updated last month
• sangmichaelxie / cs324_p2
  Project 2 (Building Large Language Models) for Stanford CS324: Understanding and Developing Large Language Models (Winter 2022)
  ☆101Updated last year
• ulrichstern / cuda-convnet
  Alex Krizhevsky's original code from Google Code
  ☆190Updated 8 years ago
• foundation-model-stack / foundation-model-stack
  🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
  ☆165Updated this week
• run-ai / llmperf
  ☆47Updated 2 months ago
• rwitten / HighPerfLLMs2024
  ☆224Updated 4 months ago
• tspeterkim / paged-attention-minimal
  a minimal cache manager for PagedAttention, on top of llama3.
  ☆45Updated 2 months ago
• triton-lang / kernels
  ☆45Updated 2 weeks ago
• unixpickle / learn-ptx
  Learning about CUDA by writing PTX code.
  ☆28Updated 8 months ago
• mlops-discord / gpu-optimization-workshop
  Slides, notes, and materials for the workshop
  ☆306Updated 5 months ago
• ColfaxResearch / cutlass-kernels
  ☆169Updated 4 months ago
• ColfaxResearch / cfx-article-src
  ☆48Updated this week
• abacusai / gh200-llm
  Packages and instructions for training and inference of LLMs on NVIDIA's new GH200 machines
  ☆19Updated 2 months ago
• pytorch-labs / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆211Updated 3 months ago
• foundation-model-stack / fms-fsdp
  🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…
  ☆193Updated this week