Alternatives and similar repositories for deep_learning_at_scale

Users that are interested in deep_learning_at_scale are comparing it to the libraries listed below

• mlops-discord / gpu-optimization-workshop
  Slides, notes, and materials for the workshop
  ☆331Updated last year
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆191Updated 3 months ago
• cfregly / ai-performance-engineering
  ☆106Updated last week
• PacktPublishing / Accelerate-Model-Training-with-PyTorch-2.X
  Accelerate Model Training with PyTorch 2.X, published by Packt
  ☆46Updated last year
• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆112Updated 3 months ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆110Updated 11 months ago
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆197Updated last year
• gpu-mode / profiling-cuda-in-torch
  ☆163Updated last year
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆48Updated last year
• huggingface / gpu-fryer
  Where GPUs get cooked 👩‍🍳🔥
  ☆279Updated 3 weeks ago
• hkproj / quantization-notes
  Notes on quantization in neural networks
  ☆97Updated last year
• rkinas / triton-resources
  A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.
  ☆393Updated 5 months ago
• milistu / cuda-cudnn-installation
  How to install CUDA & cuDNN for Machine Learning
  ☆20Updated last year
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆113Updated 2 years ago
• a-hamdi / GPU
  100 days of building GPU kernels!
  ☆492Updated 4 months ago
• LambdaLabsML / distributed-training-guide
  Best practices & guides on how to write distributed pytorch training code
  ☆470Updated 6 months ago
• hkproj / multi-latent-attention
  ☆43Updated 3 months ago
• drkennetz / cuda_examples
  Some CUDA example code with READMEs.
  ☆170Updated 5 months ago
• rasbt / RAGs
  RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
  ☆124Updated 7 months ago
• 1y33 / 100Days
  GPU Kernels
  ☆193Updated 4 months ago
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆63Updated last year
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆125Updated last year
• gpu-mode / lecture2
  Obsolete version of CUDA-mode repo -- use cuda-mode/lectures instead
  ☆26Updated last year
• rasbt / pycon2024
  Tutorial Materials for "The Fundamentals of Modern Deep Learning with PyTorch" workshop at PyCon 2024
  ☆247Updated last year
• PacktPublishing / Pretrain-Vision-and-Large-Language-Models-in-Python
  Pretrain Vision and Large Language Models in Python, Published by Packt
  ☆88Updated last year
• VikParuchuri / triton_tutorial
  Tutorials for Triton, a language for writing gpu kernels
  ☆36Updated 2 years ago
• huggingface / picotron_tutorial
  ☆214Updated 6 months ago
• hamelsmu / wandb-cicd
  ☆48Updated last year
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆181Updated 5 months ago
• warner-benjamin / commented-transformers
  Highly commented implementations of Transformers in PyTorch
  ☆137Updated 2 years ago