Alternatives and similar repositories for deep_learning_at_scale

Users that are interested in deep_learning_at_scale are comparing it to the libraries listed below

• cfregly / ai-performance-engineering
  ☆584Updated this week
• mlops-discord / gpu-optimization-workshop
  Slides, notes, and materials for the workshop
  ☆334Updated last year
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆196Updated 5 months ago
• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆113Updated 6 months ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆111Updated last year
• PacktPublishing / Accelerate-Model-Training-with-PyTorch-2.X
  Accelerate Model Training with PyTorch 2.X, published by Packt
  ☆48Updated 2 weeks ago
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆196Updated last year
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆48Updated last year
• hkproj / triton-flash-attention
  ☆219Updated 10 months ago
• huggingface / picotron_tutorial
  ☆225Updated last month
• gpu-mode / profiling-cuda-in-torch
  ☆177Updated last year
• hkproj / quantization-notes
  Notes on quantization in neural networks
  ☆109Updated last year
• gpu-mode / lecture2
  Obsolete version of CUDA-mode repo -- use cuda-mode/lectures instead
  ☆26Updated last year
• huggingface / gpu-fryer
  Where GPUs get cooked 👩‍🍳🔥
  ☆319Updated 2 months ago
• 1y33 / 100Days
  GPU Kernels
  ☆209Updated 7 months ago
• rkinas / triton-resources
  A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.
  ☆437Updated 8 months ago
• lucasdelimanogueira / PyNorch
  Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)
  ☆159Updated this week
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆117Updated 2 years ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆215Updated 8 months ago
• changjonathanc / flex-nano-vllm
  FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.
  ☆305Updated 3 weeks ago
• a-hamdi / GPU
  100 days of building GPU kernels!
  ☆540Updated 7 months ago
• NVIDIA / logits-processor-zoo
  A collection of LogitsProcessors to customize and enhance LLM behavior for specific tasks.
  ☆374Updated 4 months ago
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆128Updated 2 years ago
• hkproj / multi-latent-attention
  ☆45Updated 6 months ago
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆87Updated last year
• rasbt / RAGs
  RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
  ☆140Updated 10 months ago
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆64Updated last year
• notY0rick / cuda_practice
  My own repository containing the codes I wrote to practice CUDA programming.
  ☆63Updated 2 years ago
• LambdaLabsML / distributed-training-guide
  Best practices & guides on how to write distributed pytorch training code
  ☆543Updated last month
• Quentin-Anthony / nanoMPI
  Simple MPI implementation for prototyping or learning
  ☆289Updated 3 months ago