AkiRusProd / numpy-transformerLinks
A numpy implementation of the Transformer model in "Attention is All You Need"
☆55Updated 10 months ago
Alternatives and similar repositories for numpy-transformer
Users that are interested in numpy-transformer are comparing it to the libraries listed below
Sorting:
- ☆168Updated 5 months ago
- LLaMA 2 implemented from scratch in PyTorch☆329Updated last year
- LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch☆105Updated last year
- I will build Transformer from scratch☆69Updated last year
- Code for studying the super weight in LLM☆104Updated 6 months ago
- Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.☆51Updated last year
- Notes on quantization in neural networks☆83Updated last year
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆181Updated 3 weeks ago
- Annotated version of the Mamba paper☆482Updated last year
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆184Updated last week
- making the official triton tutorials actually comprehensible☆34Updated 2 months ago
- Prune transformer layers☆69Updated last year
- Training small GPT-2 style models using Kolmogorov-Arnold networks.☆117Updated last year
- Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.☆250Updated last year
- Contains hands-on example code for [O'reilly book "Deep Learning At Scale"](https://www.oreilly.com/library/view/deep-learning-at/9781098…☆26Updated 11 months ago
- This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…☆91Updated last year
- Custom kernels in Triton language for accelerating LLMs☆20Updated last year
- ☆190Updated 3 months ago
- This is a repo covers ai research papers pseudocodes☆14Updated last year
- An extension of the nanoGPT repository for training small MOE models.☆147Updated 2 months ago
- ☆157Updated last year
- Collection of kernels written in Triton language☆125Updated 2 months ago
- Cataloging released Triton kernels.☆226Updated 4 months ago
- Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)☆151Updated last year
- LoRA and DoRA from Scratch Implementations☆203Updated last year
- A Simplified PyTorch Implementation of Vision Transformer (ViT)☆187Updated 11 months ago
- Notes about LLaMA 2 model☆61Updated last year
- This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…☆67Updated last year
- This repository contains the experimental PyTorch native float8 training UX☆223Updated 10 months ago
- Distributed training (multi-node) of a Transformer model☆68Updated last year