Alternatives and similar repositories for numpy-transformer:

Users that are interested in numpy-transformer are comparing it to the libraries listed below

• gpu-mode / profiling-cuda-in-torch
  ☆153Updated last year
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆100Updated last year
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆60Updated last year
• hkproj / quantization-notes
  Notes on quantization in neural networks
  ☆79Updated last year
• lessw2020 / triton_kernels_for_fun_and_profit
  Custom kernels in Triton language for accelerating LLMs
  ☆18Updated last year
• knotgrass / How-Transformers-Work
  🧠 A study guide to learn about Transformers
  ☆11Updated last year
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆173Updated this week
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆216Updated 3 months ago
• melisa-writer / short-transformers
  Prune transformer layers
  ☆68Updated 10 months ago
• tintn / vision-transformer-from-scratch
  A Simplified PyTorch Implementation of Vision Transformer (ViT)
  ☆178Updated 10 months ago
• alperiox / Compact-Language-Models-via-Pruning-and-Knowledge-Distillation
  Unofficial implementation of https://arxiv.org/pdf/2407.14679
  ☆44Updated 7 months ago
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆91Updated last year
• aju22 / LLaMA2
  This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…
  ☆63Updated last year
• MekkCyber / CutlassAcademy
  A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS
  ☆156Updated 3 weeks ago
• kyegomez / FlashAttention20
  Get down and dirty with FlashAttention2.0 in pytorch, plug in and play no complex CUDA kernels
  ☆102Updated last year
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆288Updated this week
• jsbaan / transformer-from-scratch
  Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.
  ☆241Updated 11 months ago
• coaxsoft / pytorch_bert
  Tutorial for how to build BERT from scratch
  ☆91Updated 10 months ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆123Updated last month
• NVIDIA / ngpt
  Normalized Transformer (nGPT)
  ☆167Updated 4 months ago
• johnma2006 / candle
  Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.
  ☆51Updated last year
• a-hamdi / GPU
  100 days of building GPU kernels!
  ☆336Updated this week
• knotgrass / attention
  several types of attention modules written in PyTorch for learning purposes
  ☆50Updated 6 months ago
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆118Updated last week
• tridao / flash-attention-wheels
  ☆48Updated last year
• Dao-AILab / fast-hadamard-transform
  Fast Hadamard transform in CUDA, with a PyTorch interface
  ☆168Updated 10 months ago
• hkproj / triton-flash-attention
  ☆153Updated 3 months ago
• jlamprou / Infini-Attention
  Efficient Infinite Context Transformers with Infini-attention Pytorch Implementation + QwenMoE Implementation + Training Script + 1M cont…
  ☆82Updated 11 months ago
• eduardoleao052 / Autograd-from-scratch
  Documented and Unit Tested educational Deep Learning framework with Autograd from scratch.
  ☆111Updated last year
• tspeterkim / mixed-precision-from-scratch
  Mixed precision training from scratch with Tensors and CUDA
  ☆22Updated 11 months ago