lucasdelimanogueira / PyNorch

Related projects ⓘ

Alternatives and complementary repositories for PyNorch

• ulrichstern / cuda-convnet
  Alex Krizhevsky's original code from Google Code
  ☆190Updated 8 years ago
• BobMcDear / attorch
  A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
  ☆483Updated 3 weeks ago
• gpu-mode / ring-attention
  ring-attention experiments
  ☆97Updated last month
• gpu-mode / profiling-cuda-in-torch
  ☆133Updated 9 months ago
• ash-01xor / bpe.c
  Simple Byte pair Encoding mechanism used for tokenization process . written purely in C
  ☆120Updated last week
• clu0 / unet.cu
  UNet diffusion model in pure CUDA
  ☆584Updated 4 months ago
• kvfrans / jax-diffusion-transformer
  Implementation of Diffusion Transformer (DiT) in JAX
  ☆252Updated 5 months ago
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆134Updated 2 months ago
• hkproj / triton-flash-attention
  ☆44Updated last week
• EurekaLabsAI / tensor
  The Tensor (or Array)
  ☆411Updated 3 months ago
• tspeterkim / mixed-precision-from-scratch
  Mixed precision training from scratch with Tensors and CUDA
  ☆20Updated 6 months ago
• thevasudevgupta / gpt-triton
  Triton implementation of GPT/LLAMA
  ☆16Updated 2 months ago
• linjames0 / Transformer-CUDA
  An implementation of the transformer architecture onto an Nvidia CUDA kernel
  ☆157Updated last year
• Deep-Learning-Profiling-Tools / triton-viz
  ☆152Updated this week
• joey00072 / Tinytorch
  A really tiny autograd engine
  ☆87Updated 7 months ago
• johnma2006 / candle
  Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.
  ☆48Updated 7 months ago
• LambdaLabsML / distributed-training-guide
  Best practices & guides on how to write distributed pytorch training code
  ☆286Updated 2 weeks ago
• eduardoleao052 / Autograd-from-scratch
  Documented and Unit Tested educational Deep Learning framework with Autograd from scratch.
  ☆105Updated 7 months ago
• HMUNACHI / cuda-repo
  From zero to hero CUDA for accelerating maths and machine learning on GPU.
  ☆171Updated 3 months ago
• EurekaLabsAI / micrograd
  The Autograd Engine
  ☆534Updated 2 months ago
• siboehm / ShallowSpeed
  Small scale distributed training of sequential deep learning models, built on Numpy and MPI.
  ☆107Updated last year
• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆254Updated last year
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆43Updated 7 months ago
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆86Updated last year
• foundation-model-stack / fms-fsdp
  🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…
  ☆193Updated this week
• gautierdag / bpeasy
  Fast bare-bones BPE for modern tokenizer training
  ☆142Updated last month
• dshah3 / GPU-Puzzles
  Solve puzzles. Learn CUDA.
  ☆61Updated 11 months ago
• facebookresearch / optimizers
  For optimization algorithm research and development.
  ☆449Updated this week
• salykova / matmul.c
  High-Performance FP32 Matrix Multiplication on CPU
  ☆301Updated this week
• andylolu2 / simpleGEMM
  The simplest but fast implementation of matrix multiplication in CUDA.
  ☆33Updated 3 months ago