Alternatives and similar repositories for lecture2

Users that are interested in lecture2 are comparing it to the libraries listed below

• huggingface / optimum-benchmark
  🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…
  ☆323Updated 2 months ago
• gpu-mode / profiling-cuda-in-torch
  ☆178Updated last year
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆267Updated 2 weeks ago
• huggingface / picotron_tutorial
  ☆225Updated 3 weeks ago
• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆115Updated 6 months ago
• andrewkchan / yalm
  Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O
  ☆539Updated 3 months ago
• ulrichstern / cuda-convnet
  Alex Krizhevsky's original code from Google Code
  ☆197Updated 9 years ago
• rkinas / triton-resources
  A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.
  ☆441Updated 9 months ago
• lucasdelimanogueira / PyNorch
  Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)
  ☆161Updated 3 weeks ago
• hkproj / triton-flash-attention
  ☆227Updated 11 months ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆218Updated 9 months ago
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆195Updated 6 months ago
• loganwatchorn / notes-pmpp
  Notes on "Programming Massively Parallel Processors" by Hwu, Kirk, and Hajj (4th ed.)
  ☆53Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆112Updated last year
• Quentin-Anthony / nanoMPI
  Simple MPI implementation for prototyping or learning
  ☆292Updated 4 months ago
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆139Updated last year
• HenryNdubuaku / cuda-tutorials
  CUDA tutorials for Maths & ML tutorials with examples, covers multi-gpus, fused attention, winograd convolution, reinforcement learning.
  ☆205Updated 6 months ago
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆90Updated last year
• mlops-discord / gpu-optimization-workshop
  Slides, notes, and materials for the workshop
  ☆336Updated last year
• aryagxr / cuda
  coding CUDA everyday!
  ☆71Updated last week
• linjames0 / Transformer-CUDA
  An implementation of the transformer architecture onto an Nvidia CUDA kernel
  ☆196Updated 2 years ago
• SzymonOzog / GPU_Programming
  ☆86Updated last month
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆277Updated 3 months ago
• ksm26 / Efficiently-Serving-LLMs
  Learn the ins and outs of efficiently serving Large Language Models (LLMs). Dive into optimization techniques, including KV caching and L…
  ☆17Updated last year
• NVIDIA / Star-Attention
  Efficient LLM Inference over Long Sequences
  ☆393Updated 5 months ago
• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆363Updated 2 years ago
• changjonathanc / flex-nano-vllm
  FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.
  ☆321Updated last month
• 1y33 / 100Days
  GPU Kernels
  ☆210Updated 7 months ago
• hkproj / quantization-notes
  Notes on quantization in neural networks
  ☆113Updated 2 years ago
• SumanthRH / tokenization
  A comprehensive deep dive into the world of tokens
  ☆227Updated last year