Alternatives and similar repositories for numpy-transformer

Users that are interested in numpy-transformer are comparing it to the libraries listed below

• hkproj / quantization-notes
  Notes on quantization in neural networks
  ☆86Updated last year
• hkproj / triton-flash-attention
  ☆174Updated 5 months ago
• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆336Updated last year
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆152Updated 3 months ago
• melisa-writer / short-transformers
  Prune transformer layers
  ☆69Updated last year
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆109Updated last year
• Entropy-xcy / bitnet158
  ☆69Updated last year
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆72Updated last year
• huggingface / picotron_tutorial
  ☆193Updated 4 months ago
• johnma2006 / candle
  Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.
  ☆51Updated last year
• gpu-mode / profiling-cuda-in-torch
  ☆159Updated last year
• kyegomez / FlashAttention20
  Get down and dirty with FlashAttention2.0 in pytorch, plug in and play no complex CUDA kernels
  ☆106Updated last year
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆92Updated last year
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆185Updated 3 weeks ago
• aju22 / LLaMA2
  This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…
  ☆68Updated last year
• TheSeriousProgrammer / SimpleBitNet
  Simple Adaptation of BitNet
  ☆32Updated last year
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆111Updated 5 months ago
• hkproj / multi-latent-attention
  ☆39Updated last month
• mengxiayu / LLMSuperWeight
  Code for studying the super weight in LLM
  ☆107Updated 6 months ago
• tspeterkim / mixed-precision-from-scratch
  Mixed precision training from scratch with Tensors and CUDA
  ☆24Updated last year
• alperiox / Compact-Language-Models-via-Pruning-and-Knowledge-Distillation
  Unofficial implementation of https://arxiv.org/pdf/2407.14679
  ☆45Updated 9 months ago
• CG80499 / KAN-GPT-2
  Training small GPT-2 style models using Kolmogorov-Arnold networks.
  ☆119Updated last year
• Dao-AILab / fast-hadamard-transform
  Fast Hadamard transform in CUDA, with a PyTorch interface
  ☆201Updated last year
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆89Updated last year
• BobMcDear / attorch
  A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
  ☆556Updated last week
• KellerJordan / cifar10-airbench
  CIFAR-10 speedruns: 94% in 2.6 seconds and 96% in 27 seconds
  ☆252Updated 3 months ago
• knotgrass / attention
  several types of attention modules written in PyTorch for learning purposes
  ☆54Updated 8 months ago
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆61Updated last year
• ambisinister / mla-experiments
  Experiments on Multi-Head Latent Attention
  ☆92Updated 10 months ago
• ash-01xor / bpe.c
  Simple Byte pair Encoding mechanism used for tokenization process . written purely in C
  ☆133Updated 7 months ago