Alternatives and similar repositories for transformer-from-scratch

Users that are interested in transformer-from-scratch are comparing it to the libraries listed below

• jsbaan / transformer-from-scratch
  Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.
  ☆260Updated last year
• rasbt / faster-pytorch-blog
  Outlining techniques for improving the training performance of your PyTorch model without compromising its accuracy
  ☆129Updated 2 years ago
• deep-diver / semantic-segmentation-ml-pipeline
  Machine Learning Pipeline for Semantic Segmentation with TensorFlow Extended (TFX) and various GCP products
  ☆95Updated 2 years ago
• brandokoch / attention-is-all-you-need-paper
  Original transformer paper: Implementation of Vaswani, Ashish, et al. "Attention is all you need." Advances in neural information process…
  ☆240Updated last year
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆116Updated 2 years ago
• slds-lmu / seminar_multimodal_dl
  https://slds-lmu.github.io/seminar_multimodal_dl/
  ☆171Updated 2 years ago
• sunildkumar / lora_from_scratch
  Implements Low-Rank Adaptation(LoRA) Finetuning from scratch
  ☆80Updated 2 years ago
• tintn / vision-transformer-from-scratch
  A Simplified PyTorch Implementation of Vision Transformer (ViT)
  ☆208Updated last year
• ShivamRajSharma / Transformer-Architectures-From-Scratch
  Implementation of transformers based architecture in PyTorch.
  ☆54Updated 4 years ago
• sayakpaul / dreambooth-keras
  Implementation of DreamBooth in KerasCV and TensorFlow.
  ☆88Updated 2 years ago
• PacktPublishing / Deep-Learning-with-PyTorch-Lightning
  Getting Started with PyTorch Lightning, Published by Packt
  ☆161Updated 2 weeks ago
• paperswithcode / tutorials
  Basic guidance on how to contribute to Papers with Code
  ☆23Updated 3 years ago
• The-AI-Summer / learn-deep-learning
  AI Summer's complete catalog of articles
  ☆111Updated 3 years ago
• tensorops / TransformerX
  Flexible Python library providing building blocks (layers) for reproducible Transformers research (Tensorflow ✅, Pytorch 🔜, and Jax 🔜)
  ☆53Updated last year
• rasbt / cvpr2023
  ☆134Updated last year
• coaxsoft / pytorch_bert
  Tutorial for how to build BERT from scratch
  ☆99Updated last year
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆63Updated last year
• linjames0 / Transformer-CUDA
  An implementation of the transformer architecture onto an Nvidia CUDA kernel
  ☆189Updated last year
• the-full-stack / fsdl-text-recognizer-2022
  Source of the FSDL 2022 labs, which are at https://github.com/full-stack-deep-learning/fsdl-text-recognizer-2022-labs
  ☆83Updated last year
• PacktPublishing / Mastering-PyTorch
  Mastering PyTorch, published by Packt
  ☆309Updated 2 weeks ago
• Lightning-AI / tutorials
  Collection of Pytorch lightning tutorial form as rich scripts automatically transformed to ipython notebooks.
  ☆319Updated last month
• deep-diver / mlops-hf-tf-vision-models
  MLOps for Vision Models (TensorFlow) from 🤗 Transformers with TensorFlow Extended (TFX)
  ☆114Updated 2 years ago
• The-AI-Summer / JAX-examples
  A set of of fundamental operations and deep learning models using JAX
  ☆14Updated 4 years ago
• rajlm10 / D2L-Torch
  Learning PyTorch through the D2L book. A series of notebooks for the same
  ☆27Updated 3 years ago
• fastai / fastdiffusion
  Notes and plans for fastdiffusion course
  ☆209Updated 2 years ago
• joey00072 / Tinytorch
  A really tiny autograd engine
  ☆94Updated 3 months ago
• warner-benjamin / commented-transformers
  Highly commented implementations of Transformers in PyTorch
  ☆136Updated 2 years ago
• dtransposed / code_videos
  Code for any videos
  ☆28Updated last year
• wandb / Groundbreaking-Papers
  ML Research paper summaries, annotated papers and implementation walkthroughs
  ☆113Updated 3 years ago
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆92Updated 2 years ago