Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
☆46Jul 17, 2024Updated last year
Alternatives and similar repositories for out-of-the-box-fp8-training
Users that are interested in out-of-the-box-fp8-training are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆16Apr 26, 2023Updated 2 years ago
- This is a simple torch implementation of the high performance Multi-Query Attention☆16Aug 23, 2023Updated 2 years ago
- [TMLR 2022] Curvature access through the generalized Gauss-Newton's low-rank structure: Eigenvalues, eigenvectors, directional derivative…☆17Jul 19, 2023Updated 2 years ago
- Generic floating-point types in Python☆16Updated this week
- A repo based on XiLin Li's PSGD repo that extends some of the experiments.☆14Oct 7, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta☆13Nov 11, 2024Updated last year
- M4 experiment logbook☆58Aug 21, 2023Updated 2 years ago
- Flexibly track outputs and grad-outputs of torch.nn.Module.☆13Oct 6, 2023Updated 2 years ago
- Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …☆15Mar 11, 2024Updated 2 years ago
- Implementation of the LOSSGRAD optimization algorithm☆15Mar 21, 2019Updated 7 years ago
- We study toy models of skill learning.☆33Feb 3, 2026Updated 2 months ago
- AdamW optimizer for bfloat16 models in pytorch 🔥.☆39Jun 16, 2024Updated last year
- Simple Implementation of a Transformer in the new framework MLX by Apple☆19Nov 18, 2024Updated last year
- The goal of this repo is to become a benchmark for pentesting☆22Oct 25, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Import an ICS file into org to include events in your org agenda☆18Mar 30, 2026Updated 2 weeks ago
- ☆47Aug 15, 2019Updated 6 years ago
- Index of URLs to pdf files all over the internet and scripts☆25May 2, 2023Updated 2 years ago
- Microsoft Automatic Mixed Precision Library☆636Dec 1, 2025Updated 4 months ago
- Utilities for working with formulas, expressions, calls and other R objects☆17Nov 18, 2018Updated 7 years ago
- An R package for the Latent Environmental & Genetic InTeraction (LEGIT) model☆11Feb 11, 2021Updated 5 years ago
- This repo is for reproducing our results in “Lipschitz Generative Adversarial Nets”.☆11Sep 26, 2020Updated 5 years ago
- Tensor Parallelism with JAX + Shard Map☆11Sep 29, 2023Updated 2 years ago
- Tabular data imputation and generation, with flexible modeling of quantitative features via hierarchical binning (TMLR, 2025)☆16Mar 10, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Variational Autoencoder with non-euclidean (hyperbolic) latent space☆12Nov 25, 2022Updated 3 years ago
- ☆14Mar 8, 2025Updated last year
- Finds and runs debugpy for VS Code "remote attach" command line debugging.☆94Apr 8, 2026Updated last week
- My personal implementation of the model from "Qwen-VL: A Frontier Large Vision-Language Model with Versatile Abilities", they haven't rel…☆12Jan 29, 2024Updated 2 years ago
- The project proposal template for OpenBioML community projects.☆18Feb 9, 2023Updated 3 years ago
- An attempt at a SVD inpainting pipeline☆50Dec 24, 2023Updated 2 years ago
- Self-Attention Generative Adversarial Networks with Relativistic loss☆13Feb 14, 2019Updated 7 years ago
- Entailment self-training☆27May 30, 2023Updated 2 years ago
- Jax Decompiler☆16Apr 22, 2025Updated 11 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆14Apr 7, 2022Updated 4 years ago
- Classifier for CIFAR-10. Grayscaling, HOG, PCA, and RBF SVM. 62% test accuracy. Walkthrough on YouTube: https://youtu.be/gmTweV0eHhk☆14Nov 24, 2024Updated last year
- ☆16Dec 30, 2024Updated last year
- Automatic High-Order Optimization for Tensors☆22Apr 14, 2023Updated 3 years ago
- Library in C++ and a python wrapper for dealing with Page XML files☆13Apr 25, 2025Updated 11 months ago
- Synthetic Alphabet Dataset☆19Mar 27, 2025Updated last year
- A scalable implementation of diffusion and flow-matching with XGBoost models, applied to calorimeter data.☆19Mar 23, 2026Updated 3 weeks ago