warner-benjamin / commented-transformers
Highly commented implementations of Transformers in PyTorch
☆132Updated last year
Alternatives and similar repositories for commented-transformers:
Users that are interested in commented-transformers are comparing it to the libraries listed below
- Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines☆198Updated 10 months ago
- A miniture AI training framework for PyTorch☆39Updated 2 months ago
- deep learning with pytorch lightningUpdated 5 months ago
- ☆166Updated 10 months ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆82Updated last year
- ML/DL Math and Method notes☆59Updated last year
- ☆150Updated 7 months ago
- ☆92Updated last year
- An introduction to LLM Sampling☆77Updated 3 months ago
- ☆78Updated 10 months ago
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆230Updated 5 months ago
- Fast bare-bones BPE for modern tokenizer training☆152Updated 5 months ago
- ☆89Updated last month
- ☆51Updated 10 months ago
- ☆120Updated 5 months ago
- Source of the FSDL 2022 labs, which are at https://github.com/full-stack-deep-learning/fsdl-text-recognizer-2022-labs☆80Updated last year
- Source notebook code for the course, stripped of all information. Please consider puchasing the course at https://store.walkwithfastai.co…☆36Updated last year
- An interactive exploration of Transformer programming.☆261Updated last year
- ☆76Updated 8 months ago
- ☆40Updated 10 months ago
- Collection of autoregressive model implementation☆83Updated last month
- Helpers and such for working with Lambda Cloud☆51Updated last year
- An extension of the nanoGPT repository for training small MOE models.☆109Updated 3 weeks ago
- Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.☆156Updated last year
- A comprehensive deep dive into the world of tokens☆221Updated 9 months ago
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆123Updated 11 months ago
- Render notebooks like nbviewer, but using Quarto as the renderer☆100Updated 3 months ago
- A set of scripts and notebooks on LLM finetunning and dataset creation☆105Updated 6 months ago
- A miniature version of Modal☆20Updated 9 months ago
- This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resultin…☆23Updated last year