srush / pytorch-lecture

Related projects ⓘ

Alternatives and complementary repositories for pytorch-lecture

• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆86Updated last year
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆57Updated 11 months ago
• AnswerDotAI / minai
  A miniture AI training framework for PyTorch
  ☆34Updated last year
• warner-benjamin / commented-transformers
  Highly commented implementations of Transformers in PyTorch
  ☆129Updated last year
• gpu-mode / profiling-cuda-in-torch
  ☆133Updated 9 months ago
• hundredblocks / large-model-parallelism
  Functional local implementations of main model parallelism approaches
  ☆95Updated last year
• gnovack / distributed-training-and-deepspeed
  ☆13Updated last year
• gau-nernst / learn-cuda
  Learn CUDA with PyTorch
  ☆14Updated 2 weeks ago
• linjames0 / Transformer-CUDA
  An implementation of the transformer architecture onto an Nvidia CUDA kernel
  ☆157Updated last year
• sytelus / pcprep
  Scripts to prep PC for development use after OS installs
  ☆37Updated last week
• backpropagation64 / mle-interview-questions
  Interview Questions and Answers for Machine Learning Engineer role
  ☆119Updated last year
• dshah3 / GPU-Puzzles
  Solve puzzles. Learn CUDA.
  ☆61Updated 11 months ago
• srush / anynp
  Proof-of-concept of global switching between numpy/jax/pytorch in a library.
  ☆18Updated 5 months ago
• the-full-stack / fsdl-text-recognizer-2022
  Source of the FSDL 2022 labs, which are at https://github.com/full-stack-deep-learning/fsdl-text-recognizer-2022-labs
  ☆82Updated 8 months ago
• rasbt / cvpr2023
  ☆127Updated last year
• init27 / Deep-Learning-Book-Supplementary-Materials
  Supplementary Materials for the Deep Learning Book by Ian Goodfellow et al
  ☆53Updated last year
• siboehm / ShallowSpeed
  Small scale distributed training of sequential deep learning models, built on Numpy and MPI.
  ☆107Updated last year
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆195Updated 6 months ago
• rasbt / RAGs
  RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
  ☆83Updated 7 months ago
• fastai / fastbook2e
  The fastai book, 2nd edition (in progress)
  ☆47Updated 4 months ago
• cloneofsimo / min-fsdp
  ☆73Updated 4 months ago
• rasbt / faster-pytorch-blog
  Outlining techniques for improving the training performance of your PyTorch model without compromising its accuracy
  ☆124Updated last year
• dpressel / mint
  MinT: Minimal Transformer Library and Tutorials
  ☆248Updated 2 years ago
• jxtngx / lightning-lab
  deep learning with pytorch lightning
  ☆0Updated 3 weeks ago
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆47Updated 6 months ago
• drisspg / transformer_nuggets
  A place to store reusable transformer components of my own creation or found on the interwebs
  ☆44Updated 2 weeks ago
• joey00072 / Tinytorch
  A really tiny autograd engine
  ☆87Updated 7 months ago
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆252Updated last year
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆138Updated 2 months ago
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆80Updated 11 months ago