Alternatives and similar repositories for Tinytorch:

Users that are interested in Tinytorch are comparing it to the libraries listed below

• xjdr-alt / simple_transformer
  Simple Transformer in Jax
  ☆136Updated 7 months ago
• yacineMTB / just-large-models
  Just large language models. Hackable, with as little abstraction as possible. Done for my own purposes, feel free to rip.
  ☆44Updated last year
• gpu-mode / profiling-cuda-in-torch
  ☆141Updated last year
• dshah3 / GPU-Puzzles
  Solve puzzles. Learn CUDA.
  ☆62Updated last year
• Laz4rz / GPT-2
  Following master Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish
  ☆167Updated 6 months ago
• johnma2006 / candle
  Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.
  ☆51Updated 10 months ago
• linjames0 / Transformer-CUDA
  An implementation of the transformer architecture onto an Nvidia CUDA kernel
  ☆169Updated last year
• ulrichstern / cuda-convnet
  Alex Krizhevsky's original code from Google Code
  ☆189Updated 8 years ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆81Updated this week
• siboehm / ShallowSpeed
  Small scale distributed training of sequential deep learning models, built on Numpy and MPI.
  ☆117Updated last year
• KhawajaAbaid / micrograd_c
  Andrej Kapathy's micrograd implemented in c
  ☆29Updated 6 months ago
• tensoic / Cerule
  Cerule - A Tiny Mighty Vision Model
  ☆67Updated 5 months ago
• omkaark / simple-federated-learning
  ☆98Updated 9 months ago
• mikaelhaji / n1-codec
  a highly efficient compression algorithm for the n1 implant (neuralink's compression challenge)
  ☆46Updated 8 months ago
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆94Updated 2 months ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated 3 months ago
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆75Updated 2 months ago
• cloneofsimo / min-fsdp
  ☆75Updated 7 months ago
• eevaain / tiny-tpu
  A minimal Tensor Processing Unit (TPU) inspired by Google's TPUv1.
  ☆129Updated 6 months ago
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆121Updated 9 months ago
• idiap / sigma-gpt
  σ-GPT: A New Approach to Autoregressive Models
  ☆61Updated 6 months ago
• euclaise / supertrainer2000
  ☆49Updated 11 months ago
• joey00072 / Multi-Head-Latent-Attention-MLA-
  working implimention of deepseek MLA
  ☆29Updated last month
• srush / GPTWorld
  A puzzle to learn about prompting
  ☆124Updated last year
• ethansmith2000 / fsdp_optimizers
  supporting pytorch FSDP for optimizers
  ☆76Updated 2 months ago
• vdesai2014 / inference-optimization-blog-post
  ☆86Updated 11 months ago
• NVIDIA / ngpt
  Normalized Transformer (nGPT)
  ☆150Updated 2 months ago
• apoorvnandan / lilgrad
  pytorch from scratch in pure C/CUDA and python
  ☆39Updated 4 months ago
• smolorg / smoltropix
  MLX port for xjdr's entropix sampler (mimics jax implementation)
  ☆63Updated 3 months ago
• ishan0102 / rsrch.space
  Stream of my favorite papers and links
  ☆40Updated 5 months ago