Alternatives and similar repositories for numpy-transformer

Users that are interested in numpy-transformer are comparing it to the libraries listed below

• hkproj / triton-flash-attention
  ☆168Updated 5 months ago
• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆329Updated last year
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆105Updated last year
• Khaliladib11 / Transformer-from-scratch
  I will build Transformer from scratch
  ☆69Updated last year
• mengxiayu / LLMSuperWeight
  Code for studying the super weight in LLM
  ☆104Updated 6 months ago
• johnma2006 / candle
  Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.
  ☆51Updated last year
• hkproj / quantization-notes
  Notes on quantization in neural networks
  ☆83Updated last year
• MekkCyber / CutlassAcademy
  A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS
  ☆181Updated 3 weeks ago
• srush / annotated-mamba
  Annotated version of the Mamba paper
  ☆482Updated last year
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆184Updated last week
• evintunador / triton_docs_tutorials
  making the official triton tutorials actually comprehensible
  ☆34Updated 2 months ago
• melisa-writer / short-transformers
  Prune transformer layers
  ☆69Updated last year
• CG80499 / KAN-GPT-2
  Training small GPT-2 style models using Kolmogorov-Arnold networks.
  ☆117Updated last year
• jsbaan / transformer-from-scratch
  Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.
  ☆250Updated last year
• suneeta-mall / deep_learning_at_scale
  Contains hands-on example code for [O'reilly book "Deep Learning At Scale"](https://www.oreilly.com/library/view/deep-learning-at/9781098…
  ☆26Updated 11 months ago
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆91Updated last year
• lessw2020 / triton_kernels_for_fun_and_profit
  Custom kernels in Triton language for accelerating LLMs
  ☆20Updated last year
• huggingface / picotron_tutorial
  ☆190Updated 3 months ago
• Motsepe-Jr / AI-research-papers-pseudo-code
  This is a repo covers ai research papers pseudocodes
  ☆14Updated last year
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆147Updated 2 months ago
• gpu-mode / profiling-cuda-in-torch
  ☆157Updated last year
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆125Updated 2 months ago
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆226Updated 4 months ago
• lucasdelimanogueira / PyNorch
  Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)
  ☆151Updated last year
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆203Updated last year
• tintn / vision-transformer-from-scratch
  A Simplified PyTorch Implementation of Vision Transformer (ViT)
  ☆187Updated 11 months ago
• hkproj / pytorch-llama-notes
  Notes about LLaMA 2 model
  ☆61Updated last year
• aju22 / LLaMA2
  This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…
  ☆67Updated last year
• pytorch-labs / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆223Updated 10 months ago
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆68Updated last year