Alternatives and similar repositories for transformer-from-scratch

Users that are interested in transformer-from-scratch are comparing it to the libraries listed below

• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆113Updated 2 years ago
• rasbt / faster-pytorch-blog
  Outlining techniques for improving the training performance of your PyTorch model without compromising its accuracy
  ☆128Updated 2 years ago
• jsbaan / transformer-from-scratch
  Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.
  ☆257Updated last year
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆63Updated last year
• The-AI-Summer / learn-deep-learning
  AI Summer's complete catalog of articles
  ☆112Updated 3 years ago
• brandokoch / attention-is-all-you-need-paper
  Original transformer paper: Implementation of Vaswani, Ashish, et al. "Attention is all you need." Advances in neural information process…
  ☆239Updated last year
• deep-diver / semantic-segmentation-ml-pipeline
  Machine Learning Pipeline for Semantic Segmentation with TensorFlow Extended (TFX) and various GCP products
  ☆95Updated 2 years ago
• the-full-stack / fsdl-text-recognizer-2022
  Source of the FSDL 2022 labs, which are at https://github.com/full-stack-deep-learning/fsdl-text-recognizer-2022-labs
  ☆82Updated last year
• Lightning-AI / tutorials
  Collection of Pytorch lightning tutorial form as rich scripts automatically transformed to ipython notebooks.
  ☆319Updated 3 weeks ago
• slds-lmu / seminar_multimodal_dl
  https://slds-lmu.github.io/seminar_multimodal_dl/
  ☆170Updated 2 years ago
• rasbt / RAGs
  RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
  ☆124Updated 7 months ago
• rasbt / cvpr2023
  ☆134Updated last year
• eduardoleao052 / Autograd-from-scratch
  Documented and Unit Tested educational Deep Learning framework with Autograd from scratch.
  ☆120Updated last year
• fastai / fastdiffusion
  Notes and plans for fastdiffusion course
  ☆209Updated 2 years ago
• linjames0 / Transformer-CUDA
  An implementation of the transformer architecture onto an Nvidia CUDA kernel
  ☆189Updated last year
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆92Updated 2 years ago
• warner-benjamin / commented-transformers
  Highly commented implementations of Transformers in PyTorch
  ☆137Updated 2 years ago
• sayakpaul / dreambooth-keras
  Implementation of DreamBooth in KerasCV and TensorFlow.
  ☆88Updated 2 years ago
• dtransposed / code_videos
  Code for any videos
  ☆28Updated last year
• joey00072 / Tinytorch
  A really tiny autograd engine
  ☆95Updated 3 months ago
• tintn / vision-transformer-from-scratch
  A Simplified PyTorch Implementation of Vision Transformer (ViT)
  ☆200Updated last year
• ShivamRajSharma / Transformer-Architectures-From-Scratch
  Implementation of transformers based architecture in PyTorch.
  ☆54Updated 4 years ago
• TalalAhmed311 / Attention-is-all-you-Need
  ☆25Updated 2 years ago
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆209Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆110Updated 11 months ago
• Animadversio / TransformerFromScratch
  Tutorial for Harvard Medical School ML from Scratch Series: Transformer from Scratch. Demo the usage of transformer in various domains: M…
  ☆45Updated 2 years ago
• ma7dev / deep-learning-project-template
  A project template where PyTorch Lightning, Pydantic, and more! being used for training MNIST as an example.
  ☆27Updated 3 years ago
• PacktPublishing / Deep-Learning-with-PyTorch-Lightning
  Getting Started with PyTorch Lightning, Published by Packt
  ☆160Updated last year
• sidhu2690 / Deep-KAN
  This repository contains a better implementation of Kolmogorov-Arnold networks
  ☆63Updated 2 months ago
• MK2112 / nn-zero-to-hero-notes
  Jupyter Notebook notes on Andrej Karpathy's videos and the tutorial series, "Neural Networks: Zero to Hero."
  ☆185Updated this week