Alternatives and similar repositories for GPT-2

Users that are interested in GPT-2 are comparing it to the libraries listed below

• smolorg / smolgrad
  small auto-grad engine inspired from Karpathy's micrograd and PyTorch
  ☆275Updated 11 months ago
• xjdr-alt / simple_transformer
  Simple Transformer in Jax
  ☆139Updated last year
• arpitingle / gpu-alpha
  High Quality Resources on GPU Programming/Architecture
  ☆589Updated last year
• EurekaLabsAI / tensor
  The Tensor (or Array)
  ☆448Updated last year
• naklecha / llm-inference-optimizations-explained
  in this repository, i'm going to implement increasingly complex llm inference optimizations
  ☆68Updated 5 months ago
• joey00072 / Tinytorch
  A really tiny autograd engine
  ☆95Updated 4 months ago
• MarioSieg / magnetron
  (WIP) A small but powerful, homemade PyTorch from scratch.
  ☆643Updated last week
• seatedro / arxival
  ☆92Updated 9 months ago
• 0xD4rky / Vision-Transformers
  This repo has all the basic things you'll need in-order to understand complete vision transformer architecture and its various implementa…
  ☆228Updated 9 months ago
• Maharshi-Pandya / cudacodes
  Learnings and programs related to CUDA
  ☆420Updated 3 months ago
• EurekaLabsAI / mlp
  The Multilayer Perceptron Language Model
  ☆571Updated last year
• Quentin-Anthony / torch-profiling-tutorial
  ☆510Updated 2 months ago
• smolorg / smolar
  a tiny multidimensional array implementation in C similar to numpy, but only one file.
  ☆228Updated last year
• omkaark / simple-federated-learning
  ☆96Updated last year
• nuwandavek / karpathify
  ☆92Updated last year
• spikedoanz / from-bits-to-intelligence
  could we make an ml stack in 100,000 lines of code?
  ☆46Updated last year
• gautierdag / bpeasy
  Fast bare-bones BPE for modern tokenizer training
  ☆166Updated 4 months ago
• N8python / mlx-pretrain
  A simple MLX implementation for pretraining LLMs on Apple Silicon.
  ☆84Updated 2 months ago
• pranavjad / mlx-gpt2
  gpt-2 from scratch in mlx
  ☆401Updated last year
• obadakhalili / tinygrad-tensor-puzzles
  Solve puzzles to improve your tinygrad skills!
  ☆145Updated last week
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆107Updated 7 months ago
• haraschax / nograd
  Gradient descent is cool and all, but what if we could delete it?
  ☆104Updated 2 months ago
• shivendrra / SmallLanguageModel
  a LLM cookbook, for building your own from scratch, all the way from gathering data to training a model
  ☆162Updated last year
• ash-01xor / bpe.c
  Simple Byte pair Encoding mechanism used for tokenization process . written purely in C
  ☆136Updated 11 months ago
• rkinas / triton-resources
  A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.
  ☆421Updated 7 months ago
• yacineMTB / just-large-models
  Just large language models. Hackable, with as little abstraction as possible. Done for my own purposes, feel free to rip.
  ☆44Updated 2 years ago
• EleutherAI / cookbook
  Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
  ☆820Updated 2 months ago
• tokenbender / avataRL
  rl from zero pretrain, can it be done? yes.
  ☆277Updated 3 weeks ago
• smolorg / smoltropix
  MLX port for xjdr's entropix sampler (mimics jax implementation)
  ☆62Updated 11 months ago
• nano-R1 / resources
  Compiling useful links, papers, benchmarks, ideas, etc.
  ☆45Updated 7 months ago