Alternatives and similar repositories for Transformer-from-scratch

Users that are interested in Transformer-from-scratch are comparing it to the libraries listed below

• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆104Updated last year
• rasbt / RAGs
  RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
  ☆105Updated 4 months ago
• jsbaan / transformer-from-scratch
  Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.
  ☆250Updated last year
• hkproj / multi-latent-attention
  ☆35Updated last week
• deshwalmahesh / ML-Models-from-Scratch
  Repo for ML Models built from scratch such as Self-Attention, Linear +Logistic Regression, PCA, LDA. CNN, LSTM, Neural Networks using Nu…
  ☆49Updated 4 months ago
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆68Updated last year
• 1y33 / 100Days
  GPU Kernels
  ☆178Updated last month
• coaxsoft / pytorch_bert
  Tutorial for how to build BERT from scratch
  ☆93Updated last year
• hkproj / triton-flash-attention
  ☆168Updated 5 months ago
• rasbt / pycon2024
  Tutorial Materials for "The Fundamentals of Modern Deep Learning with PyTorch" workshop at PyCon 2024
  ☆242Updated last year
• AayushSameerShah / Neural-Net-Zero-to-Hero-with-Andrej
  This repository contains the collection of explorative notebooks pure in python and in the language that we, humans can read. Have tried …
  ☆111Updated last year
• Animadversio / TransformerFromScratch
  Tutorial for Harvard Medical School ML from Scratch Series: Transformer from Scratch. Demo the usage of transformer in various domains: M…
  ☆45Updated last year
• tintn / vision-transformer-from-scratch
  A Simplified PyTorch Implementation of Vision Transformer (ViT)
  ☆187Updated 11 months ago
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆46Updated last year
• AkiRusProd / numpy-transformer
  A numpy implementation of the Transformer model in "Attention is All You Need"
  ☆55Updated 10 months ago
• genaibook / genaibook
  Contains the public resources of Hands on GenAI book
  ☆152Updated 5 months ago
• jxtngx / intro-to-post-training
  learn post-training with Meta's torchtune
  ☆29Updated 2 months ago
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆122Updated last year
• a-hamdi / GPU
  100 days of building GPU kernels!
  ☆430Updated last month
• hkproj / transformer-from-scratch-notes
  Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)
  ☆281Updated 2 years ago
• hkproj / quantization-notes
  Notes on quantization in neural networks
  ☆83Updated last year
• JINO-ROHIT / advanced_ml
  ☆45Updated 3 weeks ago
• ma7dev / deep-learning-project-template
  A project template where PyTorch Lightning, Pydantic, and more! being used for training MNIST as an example.
  ☆26Updated 2 years ago
• hkproj / lazy-ml
  ML algorithms implementations that are good for learning the underlying principles
  ☆22Updated 5 months ago
• ash-01xor / bpe.c
  Simple Byte pair Encoding mechanism used for tokenization process . written purely in C
  ☆132Updated 6 months ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆111Updated 8 months ago
• ChanCheeKean / DataScience
  ☆83Updated last year
• rasbt / courses
  This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)
  ☆39Updated 2 years ago
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆203Updated last year
• karpathy / transformers
  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
  ☆126Updated 2 years ago