Alternatives and similar repositories for Transformer-from-scratch

Users that are interested in Transformer-from-scratch are comparing it to the libraries listed below

• tintn / vision-transformer-from-scratch
  A Simplified PyTorch Implementation of Vision Transformer (ViT)
  ☆223Updated last year
• jsbaan / transformer-from-scratch
  Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.
  ☆271Updated last year
• rasbt / pycon2024
  Tutorial Materials for "The Fundamentals of Modern Deep Learning with PyTorch" workshop at PyCon 2024
  ☆248Updated last year
• Lightning-AI / dl-fundamentals
  Deep Learning Fundamentals -- Code material and exercises
  ☆397Updated last year
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆117Updated 2 years ago
• 0ssamaak0 / Karpathy-Neural-Networks-Zero-to-Hero
  ☆126Updated 10 months ago
• gerdm / reinforcement-learning
  Repository of notes, code and notebooks in Python for the book "Reinforcement Learning: An Introduction" by Richard S. Sutton and Andrew …
  ☆35Updated 3 months ago
• rasbt / RAGs
  RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
  ☆140Updated 10 months ago
• gordicaleksa / pytorch-learn-reinforcement-learning
  A collection of various RL algorithms like policy gradients, DQN and PPO. The goal of this repo will be to make it a go-to resource for l…
  ☆159Updated 4 years ago
• hkproj / transformer-from-scratch-notes
  Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)
  ☆329Updated 2 years ago
• HHU-MMBS / RepresentationLearning_SS2023
  Representation Learning MSc course Summer Semester 2023
  ☆85Updated 2 years ago
• ThinamXx / build-GPT
  Building GPT ...
  ☆18Updated last year
• xbresson / CS4243_2022
  Computer Vision and Pattern Recognition, NUS CS4243, 2022
  ☆177Updated 3 years ago
• Anirudh257 / Solutions-to-Machine-Learning-Interviews-Book-By-Chip-Huyen
  ☆52Updated last year
• PacktPublishing / Mastering-PyTorch
  Mastering PyTorch, published by Packt
  ☆326Updated 3 weeks ago
• LukeDitria / pytorch_tutorials
  Beginner Level Deep Learning Tutorials in Pytorch with Youtube Videos!
  ☆442Updated last year
• PacktPublishing / Deep-Learning-with-PyTorch-Lightning
  Getting Started with PyTorch Lightning, Published by Packt
  ☆161Updated 3 weeks ago
• EdwardRaff / Inside-Deep-Learning
  Inside Deep Learning: The math, the algorithms, the models
  ☆269Updated 2 years ago
• mrdbourke / learn-transformers
  Work in progress. Simple repository to learn Transformers (and transformers).
  ☆52Updated 2 years ago
• brandokoch / attention-is-all-you-need-paper
  Original transformer paper: Implementation of Vaswani, Ashish, et al. "Attention is all you need." Advances in neural information process…
  ☆241Updated last year
• springer-llms-deep-dive / llms-deep-dive-tutorials
  ☆146Updated last year
• Nyandwi / deep-computer-vision
  Deep Learning for Computer Vision
  ☆60Updated last year
• Atcold / NYU-DLFL22
  NYU Deep Learning Fall 2022
  ☆63Updated last year
• jeffheaton / app_deep_learning
  T81-558: PyTorch - Applications of Deep Neural Networks @Washington University in St. Louis
  ☆476Updated 3 months ago
• xbresson / CS5242_2025
  NUS CS5242 Neural Networks and Deep Learning, Xavier Bresson, 2025
  ☆403Updated 7 months ago
• 1y33 / 100Days
  GPU Kernels
  ☆209Updated 7 months ago
• coaxsoft / pytorch_bert
  Tutorial for how to build BERT from scratch
  ☆100Updated last year
• wandb / edu
  Educational materials on deep learning by Weights & Biases
  ☆644Updated 10 months ago
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆129Updated 2 years ago
• bentrevett / a-tour-of-pytorch-optimizers
  A tour of different optimization algorithms in PyTorch.
  ☆99Updated 3 years ago