Alternatives and similar repositories for Transformer-from-scratch

Users that are interested in Transformer-from-scratch are comparing it to the libraries listed below

• jsbaan / transformer-from-scratch
  Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.
  ☆273Updated last year
• rasbt / pycon2024
  Tutorial Materials for "The Fundamentals of Modern Deep Learning with PyTorch" workshop at PyCon 2024
  ☆247Updated last year
• tintn / vision-transformer-from-scratch
  A Simplified PyTorch Implementation of Vision Transformer (ViT)
  ☆231Updated last year
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆119Updated 2 years ago
• hkproj / transformer-from-scratch-notes
  Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)
  ☆332Updated 2 years ago
• springer-llms-deep-dive / llms-deep-dive-tutorials
  ☆151Updated last year
• PacktPublishing / Mastering-PyTorch
  Mastering PyTorch, published by Packt
  ☆336Updated last month
• Lightning-AI / dl-fundamentals
  Deep Learning Fundamentals -- Code material and exercises
  ☆398Updated last year
• EdwardRaff / Inside-Deep-Learning
  Inside Deep Learning: The math, the algorithms, the models
  ☆272Updated 2 years ago
• HHU-MMBS / RepresentationLearning_SS2023
  Representation Learning MSc course Summer Semester 2023
  ☆87Updated 2 years ago
• 0ssamaak0 / Karpathy-Neural-Networks-Zero-to-Hero
  ☆127Updated 11 months ago
• xbresson / CS5242_2025
  NUS CS5242 Neural Networks and Deep Learning, Xavier Bresson, 2025
  ☆406Updated 8 months ago
• PacktPublishing / Deep-Learning-with-PyTorch-Lightning
  Getting Started with PyTorch Lightning, Published by Packt
  ☆162Updated last month
• rasbt / RAGs
  RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
  ☆141Updated 11 months ago
• jeffheaton / app_deep_learning
  T81-558: PyTorch - Applications of Deep Neural Networks @Washington University in St. Louis
  ☆481Updated this week
• PacktPublishing / Pretrain-Vision-and-Large-Language-Models-in-Python
  Pretrain Vision and Large Language Models in Python, Published by Packt
  ☆88Updated 2 years ago
• Atcold / NYU-DLFL22
  NYU Deep Learning Fall 2022
  ☆63Updated last year
• xbresson / GML2023
  Graph Machine Learning course, Xavier Bresson, 2023
  ☆615Updated last year
• karpathy / lecun1989-repro
  Reproducing Yann LeCun 1989 paper "Backpropagation Applied to Handwritten Zip Code Recognition", to my knowledge the earliest real-world …
  ☆704Updated last year
• Nyandwi / deep-computer-vision
  Deep Learning for Computer Vision
  ☆60Updated last year
• VachanVY / Reinforcement-Learning
  PyTorch implementations of algorithms from "Reinforcement Learning: An Introduction by Sutton and Barto", along with various RL research …
  ☆206Updated 5 months ago
• genaibook / genaibook
  Contains the public resources of Hands on GenAI book
  ☆228Updated last year
• PacktPublishing / Machine-Learning-for-Imbalanced-Data
  Machine Learning for Imbalanced Data, published by Packt
  ☆277Updated last month
• rasbt / stat453-deep-learning-ss21
  STAT 453: Intro to Deep Learning @ UW-Madison (Spring 2021)
  ☆536Updated 3 years ago
• fkodom / transformer-from-scratch
  Code implementation from my blog post: https://fkodom.substack.com/p/transformers-from-scratch-in-pytorch
  ☆97Updated 2 years ago
• xbresson / CS4243_2022
  Computer Vision and Pattern Recognition, NUS CS4243, 2022
  ☆178Updated 3 years ago
• shervinmin / awesome-deep-learning-survey-papers
  In this page, I will provide a list of survey papers on topics related to deep learning and its applications in various fields.
  ☆127Updated last year
• LukeDitria / pytorch_tutorials
  Beginner Level Deep Learning Tutorials in Pytorch with Youtube Videos!
  ☆456Updated last year
• chaklam-silpasuwanchai / Python-fo-Natural-Language-Processing
  This is the repository for the course Natural Language Processing at Asian Institute of Technology. Covers word vectors, spaCy, PyTorch…
  ☆87Updated 8 months ago
• ma7dev / deep-learning-project-template
  A project template where PyTorch Lightning, Pydantic, and more! being used for training MNIST as an example.
  ☆28Updated 3 years ago