Alternatives and similar repositories for jax-from-scratch

Users that are interested in jax-from-scratch are comparing it to the libraries listed below

• smolorg / smolgrad
  small auto-grad engine inspired from Karpathy's micrograd and PyTorch
  ☆276Updated last year
• naklecha / llm-inference-optimizations-explained
  in this repository, i'm going to implement increasingly complex llm inference optimizations
  ☆81Updated 8 months ago
• Quentin-Anthony / torch-profiling-tutorial
  ☆540Updated 5 months ago
• Laz4rz / GPT-2
  Following Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish
  ☆172Updated last year
• Maharshi-Pandya / cudacodes
  Learnings and programs related to CUDA
  ☆431Updated 7 months ago
• spikedoanz / from-bits-to-intelligence
  could we make an ml stack in 100,000 lines of code?
  ☆46Updated last year
• MarioSieg / magnetron
  (WIP) A small but powerful, homemade PyTorch from scratch.
  ☆672Updated this week
• divyamakkar0 / JAXformer
  A zero-to-one guide on scaling modern transformers with n-dimensional parallelism.
  ☆114Updated last month
• xjdr-alt / simple_transformer
  Simple Transformer in Jax
  ☆142Updated last year
• mesozoic-egg / tinygrad-notes
  Tutorials on tinygrad
  ☆453Updated 3 months ago
• smolorg / smolvecstore
  a tiny vectorstore implementation built with numpy.
  ☆64Updated last year
• obadakhalili / tinygrad-tensor-puzzles
  Solve puzzles to improve your tinygrad skills!
  ☆177Updated 3 months ago
• IST-DASLab / llmq
  Quantized LLM training in pure CUDA/C++.
  ☆233Updated last week
• seatedro / arxival
  ☆95Updated last year
• tugot17 / pmpp
  Complete solutions to the Programming Massively Parallel Processors Edition 4
  ☆647Updated 7 months ago
• wafer-ai / gpu-perf-engineering-resources
  A curriculum for learning about gpu performance engineering, from scratch to what the frontier AI labs do
  ☆301Updated 2 weeks ago
• Noumena-Network / nmoe
  MoE training for Me and You and maybe other people
  ☆331Updated 3 weeks ago
• Infatoshi / prompts
  ☆28Updated 4 months ago
• tokenbender / avataRL
  rl from zero pretrain, can it be done? yes.
  ☆286Updated 4 months ago
• arpitingle / gpu-alpha
  High Quality Resources on GPU Programming/Architecture
  ☆591Updated last year
• Quentin-Anthony / nanoMPI
  Simple MPI implementation for prototyping or learning
  ☆300Updated 5 months ago
• gau-nernst / learn-cuda
  Learn CUDA with PyTorch
  ☆185Updated this week
• smolorg / smolar
  a tiny multidimensional array implementation in C similar to numpy, but only one file.
  ☆225Updated last year
• siboehm / ShallowSpeed
  Small scale distributed training of sequential deep learning models, built on Numpy and MPI.
  ☆155Updated 2 years ago
• PrimeIntellect-ai / prime-environments
  Curated collection of community environments
  ☆208Updated this week
• Infatoshi / docs.md
  ☆90Updated last month
• rkinas / triton-resources
  A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.
  ☆457Updated 10 months ago
• 0xD4rky / Vision-Transformers
  This repo has all the basic things you'll need in-order to understand complete vision transformer architecture and its various implementa…
  ☆229Updated last year
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆195Updated 7 months ago
• cloneofsimo / ptx-tutorial-by-aislop
  PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)
  ☆66Updated 10 months ago