Alternatives and similar repositories for Transformer-from-scratch:

Users that are interested in Transformer-from-scratch are comparing it to the libraries listed below

• rasbt / RAGs
  RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
  ☆104Updated 3 months ago
• hkproj / transformer-from-scratch-notes
  Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)
  ☆273Updated last year
• jsbaan / transformer-from-scratch
  Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.
  ☆244Updated last year
• tintn / vision-transformer-from-scratch
  A Simplified PyTorch Implementation of Vision Transformer (ViT)
  ☆182Updated 10 months ago
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆102Updated last year
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆46Updated 11 months ago
• 1y33 / 100Days
  GPU Kernels
  ☆172Updated last week
• fkodom / transformer-from-scratch
  Code implementation from my blog post: https://fkodom.substack.com/p/transformers-from-scratch-in-pytorch
  ☆94Updated last year
• deshwalmahesh / ML-Models-from-Scratch
  Repo for ML Models built from scratch such as Self-Attention, Linear +Logistic Regression, PCA, LDA. CNN, LSTM, Neural Networks using Nu…
  ☆48Updated 3 months ago
• Sentdex / neural-net-internals-visualized
  Visualizing some of the internals of a neural network during training and inference.
  ☆75Updated last year
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆124Updated last year
• PacktPublishing / Pretrain-Vision-and-Large-Language-Models-in-Python
  Pretrain Vision and Large Language Models in Python, Published by Packt
  ☆87Updated last year
• EurekaLabsAI / mlp
  The Multilayer Perceptron Language Model
  ☆547Updated 9 months ago
• EurekaLabsAI / tensor
  The Tensor (or Array)
  ☆432Updated 8 months ago
• rasbt / pycon2024
  Tutorial Materials for "The Fundamentals of Modern Deep Learning with PyTorch" workshop at PyCon 2024
  ☆244Updated 11 months ago
• PacktPublishing / Mastering-PyTorch
  Mastering PyTorch, published by Packt
  ☆293Updated last year
• YuvrajSingh-mist / Paper-Replications
  A repository consisting of paper/architecture replications of classic/SOTA AI/ML papers in pytorch
  ☆189Updated last week
• ma7dev / deep-learning-project-template
  A project template where PyTorch Lightning, Pydantic, and more! being used for training MNIST as an example.
  ☆26Updated 2 years ago
• warner-benjamin / commented-transformers
  Highly commented implementations of Transformers in PyTorch
  ☆136Updated last year
• deshwalmahesh / DataScience-StudyMaterial
  Just some stuff for Interview questions, books, annotated paper, notes, cheat sheets etc etc related to ML,AI, Deep Learning and Data Sc…
  ☆114Updated last week
• ThinamXx / build-GPT
  Building GPT ...
  ☆17Updated 5 months ago
• ajhalthor / Transformer-Neural-Network
  Code Transformer neural network components piece by piece
  ☆343Updated 2 years ago
• coaxsoft / pytorch_bert
  Tutorial for how to build BERT from scratch
  ☆92Updated 11 months ago
• AkiRusProd / numpy-transformer
  A numpy implementation of the Transformer model in "Attention is All You Need"
  ☆55Updated 9 months ago
• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆214Updated last year
• springer-llms-deep-dive / llms-deep-dive-tutorials
  ☆117Updated 7 months ago
• a-r-r-o-w / kanformer
  Naively combining transformers and Kolmogorov-Arnold Networks to learn and experiment
  ☆35Updated 9 months ago
• sushant097 / Deep-Learning-Papers-Reading
  30 Days GANs Paper Reading
  ☆44Updated 2 years ago
• rasbt / MachineLearning-QandAI-book
  Machine Learning Q and AI book
  ☆417Updated 7 months ago
• karpathy / transformers
  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
  ☆122Updated 2 years ago