Alternatives and similar repositories for numpy-transformer:

Users that are interested in numpy-transformer are comparing it to the libraries listed below

• hkproj / triton-flash-attention
  ☆159Updated 4 months ago
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆60Updated last year
• Khaliladib11 / Transformer-from-scratch
  I will build Transformer from scratch
  ☆68Updated 11 months ago
• gpu-mode / profiling-cuda-in-torch
  ☆155Updated last year
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆102Updated last year
• tintn / vision-transformer-from-scratch
  A Simplified PyTorch Implementation of Vision Transformer (ViT)
  ☆182Updated 10 months ago
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆203Updated last year
• gnovack / distributed-training-and-deepspeed
  ☆17Updated last year
• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆323Updated last year
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆220Updated 3 months ago
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆92Updated last year
• johnma2006 / candle
  Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.
  ☆51Updated last year
• srush / annotated-mamba
  Annotated version of the Mamba paper
  ☆483Updated last year
• SzymonOzog / GPU_Programming
  ☆52Updated last week
• coaxsoft / pytorch_bert
  Tutorial for how to build BERT from scratch
  ☆92Updated 11 months ago
• eduardoleao052 / Autograd-from-scratch
  Documented and Unit Tested educational Deep Learning framework with Autograd from scratch.
  ☆111Updated last year
• MekkCyber / CutlassAcademy
  A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS
  ☆169Updated last month
• lucasdelimanogueira / PyNorch
  Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)
  ☆150Updated 11 months ago
• LambdaLabsML / distributed-training-guide
  Best practices & guides on how to write distributed pytorch training code
  ☆408Updated 2 months ago
• jsbaan / transformer-from-scratch
  Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.
  ☆244Updated last year
• gmontamat / poor-mans-transformers
  Implement Transformers (and Deep Learning) from scratch in NumPy
  ☆27Updated last year
• TheSeriousProgrammer / SimpleBitNet
  Simple Adaptation of BitNet
  ☆32Updated last year
• clu0 / unet.cu
  UNet diffusion model in pure CUDA
  ☆601Updated 10 months ago
• huggingface / picotron_tutorial
  ☆181Updated 2 months ago
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆168Updated last month
• shreyansh26 / Annotated-ML-Papers
  Annotations of the interesting ML papers I read
  ☆240Updated last week
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆121Updated last month
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆138Updated 2 months ago
• hkproj / quantization-notes
  Notes on quantization in neural networks
  ☆81Updated last year
• linjames0 / Transformer-CUDA
  An implementation of the transformer architecture onto an Nvidia CUDA kernel
  ☆180Updated last year