Alternatives and similar repositories for karpathy-NN-lectures:

Users that are interested in karpathy-NN-lectures are comparing it to the libraries listed below

• saurabhaloneai / Llama-3-From-Scratch-In-Pure-Jax
  This repository contain the simple llama3 implementation in pure jax.
  ☆63Updated 2 months ago
• xjdr-alt / simple_transformer
  Simple Transformer in Jax
  ☆136Updated 10 months ago
• gi0nyx / GPT-Scratch
  This repo is my attempt at a rough implementation of nanoGPT trained on a dataset of 30,000 unique Twitter usernames
  ☆24Updated last year
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆98Updated 2 months ago
• joey00072 / Tinytorch
  A really tiny autograd engine
  ☆92Updated last year
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆231Updated 6 months ago
• N8python / mlx-pretrain
  A simple MLX implementation for pretraining LLMs on Apple Silicon.
  ☆74Updated last week
• nreHieW / r-nn
  Tensor library with autograd using only Rust's standard library
  ☆67Updated 10 months ago
• smolorg / smoltropix
  MLX port for xjdr's entropix sampler (mimics jax implementation)
  ☆64Updated 6 months ago
• teknium1 / RawTransform
  A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.
  ☆30Updated last year
• kmohan321 / Research_Papers
  ☆46Updated last month
• yacineMTB / just-large-models
  Just large language models. Hackable, with as little abstraction as possible. Done for my own purposes, feel free to rip.
  ☆44Updated last year
• CarperAI / treasure_trove
  ☆22Updated last year
• attentionmech / tensorlens
  aesthetic tensor visualiser
  ☆16Updated 2 weeks ago
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆100Updated last year
• nano-R1 / resources
  Compiling useful links, papers, benchmarks, ideas, etc.
  ☆46Updated last month
• qrsch / doubutsu
  ☆23Updated 9 months ago
• sfcompute / tinynarrations
  A synthetic story narration dataset to study small audio LMs.
  ☆32Updated last year
• jaymody / picoBERT
  Like picoGPT but for BERT.
  ☆49Updated 2 years ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated 2 weeks ago
• enjalot / latent-sae
  Training code for Sparse Autoencoders on Embedding models
  ☆38Updated 2 months ago
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆32Updated 2 months ago
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆82Updated last year
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆77Updated 4 months ago
• attentionmech / smolbox
  smolbox of recipies
  ☆26Updated 2 weeks ago
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆94Updated last year
• N8python / n8loom
  A tree-based prefix cache library that allows rapid creation of looms: hierarchal branching pathways of LLM generations.
  ☆68Updated 3 months ago
• knowrohit / know_medical_dialogues
  KMD is a collection of conversational exchanges between patients and doctors on various medical topics. It aims to capture the intricaci…
  ☆24Updated last year
• sankalp1999 / Handpicked-by-Haiku-for-You
  Mention any three favourite things and get recommendations in the form of a flow chart by Claude Haiku.
  ☆12Updated last year
• smolorg / smolvecstore
  a tiny vectorstore implementation built with numpy.
  ☆62Updated last year