Alternatives and similar repositories for Transformer-from-scratch

Users that are interested in Transformer-from-scratch are comparing it to the libraries listed below

• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆118Updated 2 years ago
• jsbaan / transformer-from-scratch
  Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.
  ☆274Updated last year
• rasbt / pycon2024
  Tutorial Materials for "The Fundamentals of Modern Deep Learning with PyTorch" workshop at PyCon 2024
  ☆248Updated last year
• tintn / vision-transformer-from-scratch
  A Simplified PyTorch Implementation of Vision Transformer (ViT)
  ☆227Updated last year
• LukeDitria / pytorch_tutorials
  Beginner Level Deep Learning Tutorials in Pytorch with Youtube Videos!
  ☆453Updated last year
• gerdm / reinforcement-learning
  Repository of notes, code and notebooks in Python for the book "Reinforcement Learning: An Introduction" by Richard S. Sutton and Andrew …
  ☆35Updated 4 months ago
• Lightning-AI / dl-fundamentals
  Deep Learning Fundamentals -- Code material and exercises
  ☆397Updated last year
• krishnonwork / mathematical-methods-in-deep-learning-ipython
  Python code (in the form of Jupyter ipython notebooks) to support the book "Math and Architectures of Deep Learning" (Krishnendu Chaudhur…
  ☆234Updated last year
• PacktPublishing / Deep-Learning-with-PyTorch-Lightning
  Getting Started with PyTorch Lightning, Published by Packt
  ☆163Updated last week
• PacktPublishing / Mastering-PyTorch
  Mastering PyTorch, published by Packt
  ☆332Updated last week
• rasbt / stat453-deep-learning-ss21
  STAT 453: Intro to Deep Learning @ UW-Madison (Spring 2021)
  ☆530Updated 3 years ago
• HHU-MMBS / RepresentationLearning_SS2023
  Representation Learning MSc course Summer Semester 2023
  ☆85Updated 2 years ago
• 0ssamaak0 / Karpathy-Neural-Networks-Zero-to-Hero
  ☆127Updated 10 months ago
• ajhalthor / Transformer-Neural-Network
  Code Transformer neural network components piece by piece
  ☆369Updated 2 years ago
• hkproj / transformer-from-scratch-notes
  Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)
  ☆333Updated 2 years ago
• Nyandwi / deep-computer-vision
  Deep Learning for Computer Vision
  ☆60Updated last year
• rasbt / RAGs
  RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
  ☆141Updated 11 months ago
• chaklam-silpasuwanchai / Python-fo-Natural-Language-Processing
  This is the repository for the course Natural Language Processing at Asian Institute of Technology. Covers word vectors, spaCy, PyTorch…
  ☆85Updated 7 months ago
• mrdbourke / learn-transformers
  Work in progress. Simple repository to learn Transformers (and transformers).
  ☆52Updated 2 years ago
• karpathy / lecun1989-repro
  Reproducing Yann LeCun 1989 paper "Backpropagation Applied to Handwritten Zip Code Recognition", to my knowledge the earliest real-world …
  ☆701Updated last year
• springer-llms-deep-dive / llms-deep-dive-tutorials
  ☆149Updated last year
• EdwardRaff / Inside-Deep-Learning
  Inside Deep Learning: The math, the algorithms, the models
  ☆269Updated 2 years ago
• VachanVY / Reinforcement-Learning
  PyTorch implementations of algorithms from "Reinforcement Learning: An Introduction by Sutton and Barto", along with various RL research …
  ☆206Updated 4 months ago
• init27 / Deep-Learning-Book-Supplementary-Materials
  Supplementary Materials for the Deep Learning Book by Ian Goodfellow et al
  ☆54Updated 2 years ago
• jeffheaton / app_deep_learning
  T81-558: PyTorch - Applications of Deep Neural Networks @Washington University in St. Louis
  ☆480Updated 4 months ago
• xbresson / CS5242_2025
  NUS CS5242 Neural Networks and Deep Learning, Xavier Bresson, 2025
  ☆403Updated 8 months ago
• PacktPublishing / Pretrain-Vision-and-Large-Language-Models-in-Python
  Pretrain Vision and Large Language Models in Python, Published by Packt
  ☆88Updated 2 years ago
• AkiRusProd / numpy-transformer
  A numpy implementation of the Transformer model in "Attention is All You Need"
  ☆58Updated last year
• fkodom / transformer-from-scratch
  Code implementation from my blog post: https://fkodom.substack.com/p/transformers-from-scratch-in-pytorch
  ☆97Updated 2 years ago
• deep-learning-indaba / indaba-pracs-2022
  Notebooks for the Practicals at the Deep Learning Indaba 2022.
  ☆178Updated last year