Alternatives and similar repositories for transformer-from-scratch:

Users that are interested in transformer-from-scratch are comparing it to the libraries listed below

• coaxsoft / pytorch_bert
  Tutorial for how to build BERT from scratch
  ☆90Updated 10 months ago
• srush / annotated-mamba
  Annotated version of the Mamba paper
  ☆477Updated last year
• tintn / vision-transformer-from-scratch
  A Simplified PyTorch Implementation of Vision Transformer (ViT)
  ☆172Updated 9 months ago
• eduardoleao052 / Autograd-from-scratch
  Documented and Unit Tested educational Deep Learning framework with Autograd from scratch.
  ☆111Updated 11 months ago
• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆307Updated last year
• hkproj / triton-flash-attention
  ☆138Updated 2 months ago
• lucasdelimanogueira / PyNorch
  Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)
  ☆146Updated 9 months ago
• hkproj / transformer-from-scratch-notes
  Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)
  ☆257Updated last year
• dpressel / mint
  MinT: Minimal Transformer Library and Tutorials
  ☆253Updated 2 years ago
• linjames0 / Transformer-CUDA
  An implementation of the transformer architecture onto an Nvidia CUDA kernel
  ☆174Updated last year
• ash-01xor / bpe.c
  Simple Byte pair Encoding mechanism used for tokenization process . written purely in C
  ☆129Updated 4 months ago
• EurekaLabsAI / micrograd
  The Autograd Engine
  ☆587Updated 6 months ago
• 10-zin / cpp-micrograd
  A c/c++ implementation of micrograd: a tiny autograd engine with neural net on top.
  ☆65Updated last year
• ajhalthor / Transformer-Neural-Network
  Code Transformer neural network components piece by piece
  ☆338Updated last year
• ulrichstern / cuda-convnet
  Alex Krizhevsky's original code from Google Code
  ☆191Updated 9 years ago
• EurekaLabsAI / mlp
  The Multilayer Perceptron Language Model
  ☆544Updated 7 months ago
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆99Updated last year
• fkodom / transformer-from-scratch
  Code implementation from my blog post: https://fkodom.substack.com/p/transformers-from-scratch-in-pytorch
  ☆93Updated last year
• gautierdag / bpeasy
  Fast bare-bones BPE for modern tokenizer training
  ☆151Updated 5 months ago
• pbloem / former
  Simple transformer implementation from scratch in pytorch. (archival, latest version on codeberg)
  ☆1,081Updated last week
• sangmichaelxie / cs324_p2
  Project 2 (Building Large Language Models) for Stanford CS324: Understanding and Developing Large Language Models (Winter 2022)
  ☆102Updated 2 years ago
• clu0 / unet.cu
  UNet diffusion model in pure CUDA
  ☆600Updated 8 months ago
• srush / Transformer-Puzzles
  Puzzles for exploring transformers
  ☆335Updated last year
• rasbt / RAGs
  RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
  ☆97Updated 2 months ago
• facebookresearch / optimizers
  For optimization algorithm research and development.
  ☆501Updated this week
• sgrvinod / a-PyTorch-Tutorial-to-Transformers
  Attention Is All You Need | a PyTorch Tutorial to Transformers
  ☆302Updated last year
• johnma2006 / candle
  Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.
  ☆51Updated 11 months ago
• neubig / anlp-code
  ☆174Updated last year
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆62Updated 11 months ago
• 1y33 / 100Days
  GPU Kernels
  ☆155Updated this week