Alternatives and similar repositories for transformers:

Users that are interested in transformers are comparing it to the libraries listed below

• EurekaLabsAI / tensor
  The Tensor (or Array)
  ☆423Updated 6 months ago
• EurekaLabsAI / mlp
  The Multilayer Perceptron Language Model
  ☆538Updated 6 months ago
• karpathy / lecun1989-repro
  Reproducing Yann LeCun 1989 paper "Backpropagation Applied to Handwritten Zip Code Recognition", to my knowledge the earliest real-world …
  ☆623Updated last year
• EurekaLabsAI / micrograd
  The Autograd Engine
  ☆573Updated 5 months ago
• 0ssamaak0 / Karpathy-Neural-Networks-Zero-to-Hero
  ☆117Updated 3 weeks ago
• MK2112 / nn-zero-to-hero-notes
  Jupyter Notebook notes on Andrej Karpathy's tutorial series, "Neural Networks: Zero to Hero."
  ☆143Updated this week
• Khaliladib11 / Transformer-from-scratch
  I will build Transformer from scratch
  ☆57Updated 9 months ago
• fastai / course22p2
  course.fast.ai 2022 part 2
  ☆487Updated 9 months ago
• smolorg / smolgrad
  small auto-grad engine inspired from Karpathy's micrograd and PyTorch
  ☆248Updated 2 months ago
• hkproj / transformer-from-scratch-notes
  Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)
  ☆249Updated last year
• 10-zin / cpp-micrograd
  A c/c++ implementation of micrograd: a tiny autograd engine with neural net on top.
  ☆63Updated last year
• karpathy / randomfun
  Notebooks and various random fun
  ☆1,089Updated last year
• 0xD4rky / Vision-Transformers
  This repo has all the basic things you'll need in-order to understand complete vision transformer architecture and its various implementa…
  ☆203Updated last month
• AayushSameerShah / Neural-Net-Zero-to-Hero-with-Andrej
  This repository contains the collection of explorative notebooks pure in python and in the language that we, humans can read. Have tried …
  ☆107Updated 9 months ago
• Maharshi-Pandya / cudacodes
  Learnings and programs related to CUDA
  ☆262Updated this week
• ajhalthor / Transformer-Neural-Network
  Code Transformer neural network components piece by piece
  ☆331Updated last year
• karpathy / karpathy
  root repo
  ☆37Updated last year
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆197Updated 9 months ago
• Laz4rz / GPT-2
  Following master Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish
  ☆167Updated 6 months ago
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆124Updated last year
• wandb / edu
  Educational materials on deep learning by Weights & Biases
  ☆595Updated last month
• hkproj / mistral-src-commented
  Reference implementation of Mistral AI 7B v0.1 model.
  ☆28Updated last year
• EleutherAI / cookbook
  Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
  ☆772Updated 3 weeks ago
• moe18 / DeepMLeet
  ☆55Updated 7 months ago
• kvfrans / jax-diffusion-transformer
  Implementation of Diffusion Transformer (DiT) in JAX
  ☆265Updated 8 months ago
• rasbt / pycon2024
  Tutorial Materials for "The Fundamentals of Modern Deep Learning with PyTorch" workshop at PyCon 2024
  ☆241Updated 9 months ago
• clu0 / unet.cu
  UNet diffusion model in pure CUDA
  ☆598Updated 7 months ago
• ash-01xor / bpe.c
  Simple Byte pair Encoding mechanism used for tokenization process . written purely in C
  ☆126Updated 3 months ago