Alternatives and similar repositories for Transformer-from-scratch:

Users that are interested in Transformer-from-scratch are comparing it to the libraries listed below

• tintn / vision-transformer-from-scratch
  A Simplified PyTorch Implementation of Vision Transformer (ViT)
  ☆178Updated 10 months ago
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆101Updated last year
• jsbaan / transformer-from-scratch
  Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.
  ☆241Updated 11 months ago
• rasbt / pycon2024
  Tutorial Materials for "The Fundamentals of Modern Deep Learning with PyTorch" workshop at PyCon 2024
  ☆244Updated 11 months ago
• hkproj / triton-flash-attention
  ☆153Updated 3 months ago
• ajhalthor / Transformer-Neural-Network
  Code Transformer neural network components piece by piece
  ☆338Updated last year
• 1y33 / 100Days
  GPU Kernels
  ☆160Updated last week
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆124Updated last year
• fkodom / transformer-from-scratch
  Code implementation from my blog post: https://fkodom.substack.com/p/transformers-from-scratch-in-pytorch
  ☆93Updated last year
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆64Updated last year
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆47Updated 10 months ago
• Lightning-AI / dl-fundamentals
  Deep Learning Fundamentals -- Code material and exercises
  ☆369Updated last year
• rasbt / RAGs
  RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
  ☆100Updated 2 months ago
• ThinamXx / build-GPT
  Building GPT ...
  ☆17Updated 4 months ago
• gerdm / reinforcement-learning
  Repository of notes, code and notebooks in Python for the book "Reinforcement Learning: An Introduction" by Richard S. Sutton and Andrew …
  ☆30Updated this week
• PacktPublishing / Mastering-PyTorch
  Mastering PyTorch, published by Packt
  ☆288Updated last year
• HHU-MMBS / RepresentationLearning_SS2023
  Representation Learning MSc course Summer Semester 2023
  ☆75Updated last year
• genaibook / genaibook
  Contains the public resources of Hands on GenAI book
  ☆124Updated 3 months ago
• hkproj / 100-days-of-gpu
  ☆232Updated last week
• hkproj / quantization-notes
  Notes on quantization in neural networks
  ☆79Updated last year
• maciejbalawejder / Deep-Learning-Collection
  ☆62Updated 2 years ago
• Atcold / NYU-DLFL22
  NYU Deep Learning Fall 2022
  ☆58Updated 7 months ago
• bentrevett / a-tour-of-pytorch-optimizers
  A tour of different optimization algorithms in PyTorch.
  ☆95Updated 3 years ago
• YuvrajSingh-mist / Paper-Replications
  A repository consisting of paper/architecture replications of classic/SOTA AI/ML papers in pytorch
  ☆158Updated last week
• ariG23498 / fine-tune-paligemma
  Notebooks for fine tuning pali gemma
  ☆100Updated this week
• eduardoleao052 / Autograd-from-scratch
  Documented and Unit Tested educational Deep Learning framework with Autograd from scratch.
  ☆110Updated last year
• PacktPublishing / Deep-Learning-with-PyTorch-Lightning
  Getting Started with PyTorch Lightning, Published by Packt
  ☆156Updated last year
• MK2112 / nn-zero-to-hero-notes
  Jupyter Notebook notes on Andrej Karpathy's videos and the tutorial series, "Neural Networks: Zero to Hero."
  ☆160Updated this week
• ma7dev / deep-learning-project-template
  A project template where PyTorch Lightning, Pydantic, and more! being used for training MNIST as an example.
  ☆26Updated 2 years ago
• AakashKumarNain / diffusion_models
  All about the fundamentals and working of Diffusion Models
  ☆155Updated 2 years ago