stanford-cs149 / cs149gpt

Related projects: ⓘ

• siboehm / ShallowSpeed
  Small scale distributed training of sequential deep learning models, built on Numpy and MPI.
  ☆88Updated 11 months ago
• cuda-mode / triton-index
  Cataloging released Triton kernels.
  ☆111Updated 3 weeks ago
• Deep-Learning-Profiling-Tools / triton-viz
  ☆124Updated last week
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆48Updated 2 weeks ago
• triton-lang / kernels
  ☆27Updated 3 weeks ago
• apple / ml-recurrent-drafter
  ☆61Updated 3 weeks ago
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆123Updated last month
• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆29Updated last month
• Jokeren / triton-samples
  ☆22Updated last week
• vedantroy / gpu_kernels
  ☆22Updated 8 months ago
• DachengLi1 / AMP
  (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.
  ☆33Updated last year
• cuda-mode / ring-attention
  ring-attention experiments
  ☆89Updated 5 months ago
• RulinShao / FastCkpt
  Python package for rematerialization-aware gradient checkpointing
  ☆22Updated 10 months ago
• stanford-futuredata / stk
  ☆83Updated 3 weeks ago
• ColfaxResearch / cutlass-kernels
  ☆138Updated 2 months ago
• RulinShao / LightSeq
  Official repository for LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers
  ☆183Updated last month
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆58Updated this week
• foundation-model-stack / fms-fsdp
  🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…
  ☆150Updated last week
• efeslab / Atom
  [MLSys'24] Atom: Low-bit Quantization for Efficient and Accurate LLM Serving
  ☆258Updated 2 months ago
• anyscale / llm-continuous-batching-benchmarks
  ☆108Updated 6 months ago
• LMCache / LMCache
  ☆32Updated last week
• parasj / checkmate
  Training neural networks in TensorFlow 2.0 with 5x less memory
  ☆127Updated 2 years ago
• hao-ai-lab / MuxServe
  ☆30Updated 3 months ago
• microsoft / DeepSpeed-Kernels
  ☆50Updated 3 months ago
• foundation-model-stack / foundation-model-stack
  🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
  ☆144Updated this week
• shawntan / scattermoe
  Triton-based implementation of Sparse Mixture of Experts.
  ☆166Updated last month
• exists-forall / striped_attention
  ☆35Updated 10 months ago
• TobiasNorlund / retro
  Official repo to On the Generalization Ability of Retrieval-Enhanced Transformers
  ☆35Updated 3 months ago
• awslabs / slapo
  A schedule language for large model training
  ☆139Updated 3 months ago
• WukLab / preble
  Stateful LLM Serving
  ☆25Updated last month
• microsoft / sarathi-serve
  A low-latency & high-throughput serving engine for LLMs
  ☆174Updated last week