fastai / minai
A miniture AI training framework for PyTorch
☆34Updated 11 months ago
Related projects: ⓘ
- Source notebook code for the course, stripped of all information. Please consider puchasing the course at https://store.walkwithfastai.co…☆34Updated 7 months ago
- Highly commented implementations of Transformers in PyTorch☆126Updated last year
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆81Updated last year
- Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers☆53Updated 2 months ago
- Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…☆42Updated 8 months ago
- A set of scripts and notebooks on LLM finetunning and dataset creation☆89Updated this week
- Set of scripts to finetune LLMs☆36Updated 5 months ago
- Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines☆195Updated 4 months ago
- ML/DL Math and Method notes☆56Updated 9 months ago
- ☆89Updated 11 months ago
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆26Updated last year
- ☆22Updated last year
- Train fastai models faster (and other useful tools)☆61Updated 3 months ago
- Helpers and such for working with Lambda Cloud☆51Updated 10 months ago
- Code for NeurIPS LLM Efficiency Challenge☆52Updated 5 months ago
- Collection of autoregressive model implementation☆62Updated 2 weeks ago
- QLoRA with Enhanced Multi GPU Support☆36Updated last year
- ☆24Updated last year
- A place to store reusable transformer components of my own creation or found on the interwebs☆43Updated 3 weeks ago
- ☆72Updated 3 months ago
- ☆42Updated 3 weeks ago
- The fastai book, 2nd edition (in progress)☆46Updated 2 months ago
- A library for squeakily cleaning and filtering language datasets.☆45Updated last year
- Gzip and nearest neighbors for text classification☆56Updated last year
- This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…☆84Updated last year
- ☆48Updated 11 months ago
- Pragmatic approach to parsing import profiles for CI's☆11Updated 2 months ago
- ☆56Updated 6 months ago
- Repository containing awesome resources regarding Hugging Face tooling.☆43Updated 8 months ago
- Lightning HPO & Training Studio App☆17Updated last year