Alternatives and similar repositories for transformers:

Users that are interested in transformers are comparing it to the libraries listed below

• EurekaLabsAI / tensor
  The Tensor (or Array)
  ☆425Updated 7 months ago
• ajhalthor / Transformer-Neural-Network
  Code Transformer neural network components piece by piece
  ☆335Updated last year
• karpathy / lecun1989-repro
  Reproducing Yann LeCun 1989 paper "Backpropagation Applied to Handwritten Zip Code Recognition", to my knowledge the earliest real-world …
  ☆626Updated last year
• EurekaLabsAI / mlp
  The Multilayer Perceptron Language Model
  ☆540Updated 7 months ago
• smolorg / smolgrad
  small auto-grad engine inspired from Karpathy's micrograd and PyTorch
  ☆251Updated 3 months ago
• karpathy / examples
  A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.
  ☆102Updated 6 years ago
• MK2112 / nn-zero-to-hero-notes
  Jupyter Notebook notes on Andrej Karpathy's videos and the tutorial series, "Neural Networks: Zero to Hero."
  ☆149Updated this week
• ash-01xor / bpe.c
  Simple Byte pair Encoding mechanism used for tokenization process . written purely in C
  ☆128Updated 4 months ago
• karpathy / calorie
  nice and effective super simple calorie counter web app
  ☆94Updated 9 months ago
• EurekaLabsAI / micrograd
  The Autograd Engine
  ☆578Updated 6 months ago
• karpathy / karpathy
  root repo
  ☆36Updated last year
• AayushSameerShah / Neural-Net-Zero-to-Hero-with-Andrej
  This repository contains the collection of explorative notebooks pure in python and in the language that we, humans can read. Have tried …
  ☆107Updated 10 months ago
• hkproj / transformer-from-scratch-notes
  Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)
  ☆256Updated last year
• fastai / course22p2
  course.fast.ai 2022 part 2
  ☆492Updated 10 months ago
• saurabhaloneai / History-of-Deep-Learning
  learningggggggg 🐳
  ☆283Updated 2 months ago
• kvfrans / jax-diffusion-transformer
  Implementation of Diffusion Transformer (DiT) in JAX
  ☆267Updated 9 months ago
• karpathy / randomfun
  Notebooks and various random fun
  ☆1,090Updated last year
• Maharshi-Pandya / cudacodes
  Learnings and programs related to CUDA
  ☆323Updated 3 weeks ago
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆99Updated last year
• Laz4rz / GPT-2
  Following master Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish
  ☆169Updated 7 months ago
• YuvrajSingh-mist / Paper-Replications
  A repository consisting of paper/architecture replications of classic/SOTA AI/ML papers in pytorch
  ☆105Updated this week
• gautierdag / bpeasy
  Fast bare-bones BPE for modern tokenizer training
  ☆149Updated 4 months ago
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆124Updated last year
• Anri-Lombard / micrograd
  Building Andrej Kapathy's micrograd from scratch
  ☆35Updated last year
• victor-explore / AI-Q-Papers-IISC-Banglore
  Question paper of courses taught at IISC as part of MTech AI curriculum
  ☆58Updated 3 months ago
• 10-zin / cpp-micrograd
  A c/c++ implementation of micrograd: a tiny autograd engine with neural net on top.
  ☆65Updated last year
• EleutherAI / cookbook
  Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
  ☆782Updated last week
• clu0 / unet.cu
  UNet diffusion model in pure CUDA
  ☆600Updated 8 months ago