hal-314 / fastai-batch-size-finder
Implementation of OpenAI paper with Simple Noise Scale on Fastai V2
☆19Updated 3 years ago
Alternatives and similar repositories for fastai-batch-size-finder:
Users that are interested in fastai-batch-size-finder are comparing it to the libraries listed below
- A PyTorch only inference wrapper for fastai☆12Updated last year
- Utilities for PyTorch distributed☆23Updated 3 weeks ago
- In-place debugger for the fastai library and pytorch☆28Updated 3 years ago
- A collection of optimizers, some arcane others well known, for Flax.☆29Updated 3 years ago
- Contains my experiments with the `big_vision` repo to train ViTs on ImageNet-1k.☆22Updated 2 years ago
- TPU support for the fastai library☆13Updated 3 years ago
- Research repo for code that may or may not end up in fastai3☆50Updated 3 years ago
- Various transformers for FSDP research☆37Updated 2 years ago
- HomebrewNLP in JAX flavour for maintable TPU-Training☆48Updated last year
- A library for squeakily cleaning and filtering language datasets.☆46Updated last year
- PyTorch interface for TrueGrad Optimizers☆42Updated last year
- Train fastai models faster (and other useful tools)☆64Updated 9 months ago
- An unofficial Python client library for Lambda Lab's Cloud Computing Platform☆12Updated 2 years ago
- Cyclemoid implementation for PyTorch☆87Updated 2 years ago
- Another attempt at a long-context / efficient transformer by me☆37Updated 2 years ago
- My explorations into editing the knowledge and memories of an attention network☆34Updated 2 years ago
- A place to store reusable transformer components of my own creation or found on the interwebs☆48Updated last week
- DiCE: The Infinitely Differentiable Monte-Carlo Estimator☆31Updated last year
- A case study of efficient training of large language models using commodity hardware.☆68Updated 2 years ago
- Build fast gradio demos of fastai learners☆35Updated 3 years ago
- Re-implementation of 'Grokking: Generalization beyond overfitting on small algorithmic datasets'☆38Updated 3 years ago
- A Python package to allow fastai to run on TPUs using Pytorch-XLA☆36Updated last year
- A miniture AI training framework for PyTorch☆39Updated last month
- A dashboard for exploring timm learning rate schedulers☆19Updated 4 months ago
- ☆31Updated last month
- Automatically take good care of your preemptible TPUs☆36Updated last year
- A GPT, made only of MLPs, in Jax☆57Updated 3 years ago
- Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers☆87Updated 8 months ago
- ☆22Updated last year
- An implementation of the Llama architecture, to instruct and delight☆21Updated 2 months ago