Alternatives and similar repositories for transformer-from-scratch

Users that are interested in transformer-from-scratch are comparing it to the libraries listed below

• coaxsoft / pytorch_bert
  Tutorial for how to build BERT from scratch
  ☆99Updated last year
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆116Updated 2 years ago
• bkitano / llama-from-scratch
  Llama from scratch, or How to implement a paper without crying
  ☆578Updated last year
• Khaliladib11 / Transformer-from-scratch
  I will build Transformer from scratch
  ☆81Updated last month
• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆350Updated last year
• hkproj / transformer-from-scratch-notes
  Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)
  ☆308Updated 2 years ago
• tintn / vision-transformer-from-scratch
  A Simplified PyTorch Implementation of Vision Transformer (ViT)
  ☆205Updated last year
• sgrvinod / a-PyTorch-Tutorial-to-Transformers
  Attention Is All You Need | a PyTorch Tutorial to Transformers
  ☆338Updated last year
• dpressel / mint
  MinT: Minimal Transformer Library and Tutorials
  ☆257Updated 3 years ago
• sangmichaelxie / cs324_p2
  Project 2 (Building Large Language Models) for Stanford CS324: Understanding and Developing Large Language Models (Winter 2022)
  ☆105Updated 2 years ago
• srush / annotated-mamba
  Annotated version of the Mamba paper
  ☆489Updated last year
• ajhalthor / Transformer-Neural-Network
  Code Transformer neural network components piece by piece
  ☆362Updated 2 years ago
• shreyansh26 / Annotated-ML-Papers
  Annotations of the interesting ML papers I read
  ☆251Updated last month
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆110Updated 11 months ago
• lucasdelimanogueira / PyNorch
  Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)
  ☆158Updated last year
• pacman100 / LLM-Workshop
  LLM Workshop by Sourab Mangrulkar
  ☆394Updated last year
• eduardoleao052 / Autograd-from-scratch
  Documented and Unit Tested educational Deep Learning framework with Autograd from scratch.
  ☆120Updated last year
• rasbt / pycon2024
  Tutorial Materials for "The Fundamentals of Modern Deep Learning with PyTorch" workshop at PyCon 2024
  ☆248Updated last year
• gordicaleksa / get-started-with-JAX
  The purpose of this repo is to make it easy to get started with JAX, Flax, and Haiku. It contains my "Machine Learning with JAX" series o…
  ☆750Updated last year
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆256Updated last year
• huggingface / large_language_model_training_playbook
  An open collection of implementation tips, tricks and resources for training large language models
  ☆479Updated 2 years ago
• aju22 / LLaMA2
  This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…
  ☆71Updated last year
• warner-benjamin / commented-transformers
  Highly commented implementations of Transformers in PyTorch
  ☆136Updated 2 years ago
• NielsRogge / Vision-Transformer-papers
  This repository contains an overview of important follow-up works based on the original Vision Transformer (ViT) by Google.
  ☆181Updated 3 years ago
• neubig / anlp-code
  ☆184Updated last year
• LambdaLabsML / distributed-training-guide
  Best practices & guides on how to write distributed pytorch training code
  ☆475Updated 6 months ago
• srush / Autodiff-Puzzles
  ☆453Updated 10 months ago
• neubig / minllama-assignment
  ☆95Updated 11 months ago
• hkproj / quantization-notes
  Notes on quantization in neural networks
  ☆98Updated last year
• srush / Transformer-Puzzles
  Puzzles for exploring transformers
  ☆368Updated 2 years ago