Alternatives and similar repositories for poor-mans-transformers:

Users that are interested in poor-mans-transformers are comparing it to the libraries listed below

• AkiRusProd / numpy-transformer
  A numpy implementation of the Transformer model in "Attention is All You Need"
  ☆53Updated 6 months ago
• coaxsoft / pytorch_bert
  Tutorial for how to build BERT from scratch
  ☆86Updated 8 months ago
• hkproj / mistral-src-commented
  Reference implementation of Mistral AI 7B v0.1 model.
  ☆28Updated last year
• lucasdelimanogueira / PyNorch
  Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)
  ☆140Updated 7 months ago
• jsbaan / transformer-from-scratch
  Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.
  ☆233Updated 9 months ago
• gpu-mode / profiling-cuda-in-torch
  ☆140Updated 11 months ago
• hkproj / transformer-from-scratch-notes
  Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)
  ☆239Updated last year
• srush / annotated-mamba
  Annotated version of the Mamba paper
  ☆471Updated 11 months ago
• uygarkurt / BERT-PyTorch
  ☆16Updated 3 weeks ago
• johnma2006 / candle
  Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.
  ☆50Updated 9 months ago
• myscience / x-lstm
  Pytorch implementation of the xLSTM model by Beck et al. (2024)
  ☆152Updated 5 months ago
• Entropy-xcy / bitnet158
  ☆68Updated 10 months ago
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆95Updated last year
• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆287Updated last year
• warner-benjamin / commented-transformers
  Highly commented implementations of Transformers in PyTorch
  ☆132Updated last year
• Khaliladib11 / Transformer-from-scratch
  I will build Transformer from scratch
  ☆53Updated 8 months ago
• tinygrad / teenygrad
  If tinygrad wasn't small enough for you...
  ☆677Updated 10 months ago
• pbelcak / fastfeedforward
  A repository for log-time feedforward networks
  ☆218Updated 9 months ago
• mesozoic-egg / tinygrad-notes
  Tutorials on tinygrad
  ☆314Updated this week
• andrewgcodes / xlstm
  my attempts at implementing various bits of Sepp Hochreiter's new xLSTM architecture
  ☆129Updated 8 months ago
• nanowell / AdEMAMix-Optimizer-Pytorch
  The AdEMAMix Optimizer: Better, Faster, Older.
  ☆178Updated 4 months ago
• ChanCheeKean / DataScience
  ☆78Updated 10 months ago
• hkproj / triton-flash-attention
  ☆110Updated 3 weeks ago
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆58Updated last year
• melisa-writer / short-transformers
  Prune transformer layers
  ☆67Updated 8 months ago
• EurekaLabsAI / tensor
  The Tensor (or Array)
  ☆420Updated 5 months ago
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆50Updated 9 months ago
• gordicaleksa / get-started-with-JAX
  The purpose of this repo is to make it easy to get started with JAX, Flax, and Haiku. It contains my "Machine Learning with JAX" series o…
  ☆680Updated last year
• Whiax / BERT-Transformer-Pytorch
  Basic implementation of BERT and Transformer in Pytorch in one short python file (also includes "predict next word" GPT task)
  ☆41Updated last year
• SynodicMonth / ChebyKAN
  Kolmogorov-Arnold Networks (KAN) using Chebyshev polynomials instead of B-splines.
  ☆360Updated 8 months ago