Alternatives and similar repositories for deep_learning_at_scale

Users that are interested in deep_learning_at_scale are comparing it to the libraries listed below

• mlops-discord / gpu-optimization-workshop
  Slides, notes, and materials for the workshop
  ☆336Updated last year
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆195Updated 6 months ago
• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆115Updated 6 months ago
• cfregly / ai-performance-engineering
  ☆767Updated this week
• hkproj / quantization-notes
  Notes on quantization in neural networks
  ☆113Updated 2 years ago
• lucasdelimanogueira / PyNorch
  Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)
  ☆161Updated 3 weeks ago
• a-hamdi / GPU
  100 days of building GPU kernels!
  ☆552Updated 7 months ago
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆49Updated last year
• 1y33 / 100Days
  GPU Kernels
  ☆210Updated 7 months ago
• rkinas / triton-resources
  A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.
  ☆441Updated 9 months ago
• gpu-mode / profiling-cuda-in-torch
  ☆178Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆112Updated last year
• PacktPublishing / Accelerate-Model-Training-with-PyTorch-2.X
  Accelerate Model Training with PyTorch 2.X, published by Packt
  ☆48Updated this week
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆117Updated 2 years ago
• huggingface / picotron_tutorial
  ☆225Updated 3 weeks ago
• drkennetz / cuda_examples
  Some CUDA example code with READMEs.
  ☆179Updated last month
• hkproj / triton-flash-attention
  ☆227Updated 11 months ago
• LambdaLabsML / distributed-training-guide
  Best practices & guides on how to write distributed pytorch training code
  ☆552Updated last month
• BBischof / ESRecsys
  Effective and Scalable Recommendation Systems
  ☆60Updated last year
• changjonathanc / flex-nano-vllm
  FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.
  ☆321Updated last month
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆90Updated last year
• rasbt / RAGs
  RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
  ☆141Updated 11 months ago
• rasbt / pycon2024
  Tutorial Materials for "The Fundamentals of Modern Deep Learning with PyTorch" workshop at PyCon 2024
  ☆248Updated last year
• hkproj / transformer-from-scratch-notes
  Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)
  ☆331Updated 2 years ago
• Lightning-AI / dl-fundamentals
  Deep Learning Fundamentals -- Code material and exercises
  ☆397Updated last year
• gpu-mode / lecture2
  Obsolete version of CUDA-mode repo -- use cuda-mode/lectures instead
  ☆26Updated last year
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆218Updated 9 months ago
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆196Updated last year
• aniketmaurya / python-project-template
  A template to kick-start your Python project ✨🚀
  ☆53Updated 5 months ago
• evintunador / triton_docs_tutorials
  making the official triton tutorials actually comprehensible
  ☆82Updated 3 months ago