Alternatives and similar repositories for deep_learning_at_scale

Users that are interested in deep_learning_at_scale are comparing it to the libraries listed below

• mlops-discord / gpu-optimization-workshop
  Slides, notes, and materials for the workshop
  ☆339Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆115Updated last year
• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆117Updated 8 months ago
• PacktPublishing / Accelerate-Model-Training-with-PyTorch-2.X
  Accelerate Model Training with PyTorch 2.X, published by Packt
  ☆51Updated last month
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆195Updated 8 months ago
• gpu-mode / profiling-cuda-in-torch
  ☆178Updated last year
• cfregly / ai-performance-engineering
  ☆976Updated last week
• milistu / cuda-cudnn-installation
  How to install CUDA & cuDNN for Machine Learning
  ☆20Updated last year
• LambdaLabsML / distributed-training-guide
  Best practices & guides on how to write distributed pytorch training code
  ☆571Updated 3 months ago
• huggingface / picotron_tutorial
  ☆230Updated 2 months ago
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆122Updated 2 years ago
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆92Updated last year
• rasbt / RAGs
  RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
  ☆141Updated last year
• 1y33 / 100Days
  GPU Kernels
  ☆218Updated 9 months ago
• hkproj / triton-flash-attention
  ☆235Updated last year
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆49Updated last year
• changjonathanc / flex-nano-vllm
  FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.
  ☆334Updated 2 months ago
• a-hamdi / GPU
  100 days of building GPU kernels!
  ☆567Updated 9 months ago
• rasbt / pycon2024
  Tutorial Materials for "The Fundamentals of Modern Deep Learning with PyTorch" workshop at PyCon 2024
  ☆247Updated last year
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆231Updated 10 months ago
• Lightning-AI / dl-fundamentals
  Deep Learning Fundamentals -- Code material and exercises
  ☆398Updated last year
• rkinas / triton-resources
  A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.
  ☆457Updated 10 months ago
• mlops-discord / dmls-bookclub
  ☆77Updated last year
• lucasdelimanogueira / PyNorch
  Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)
  ☆162Updated 2 months ago
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆196Updated last year
• hkproj / quantization-notes
  Notes on quantization in neural networks
  ☆117Updated 2 years ago
• hkproj / multi-latent-attention
  ☆46Updated 8 months ago
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆215Updated last year
• drkennetz / cuda_examples
  Some CUDA example code with READMEs.
  ☆179Updated 2 months ago
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆129Updated 2 years ago