AdamW optimizer for bfloat16 models in pytorch π₯.
β39Jun 16, 2024Updated last year
Alternatives and similar repositories for adamw_bfloat16
Users that are interested in adamw_bfloat16 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- β12Apr 26, 2024Updated last year
- βοΈ Sentence segmentation with wtpsplit's state-of-the-art Segment any Text (SaT) modelsβ38Oct 1, 2025Updated 6 months ago
- β16Dec 30, 2024Updated last year
- 4G GPU & 10 Minutes for trainβ12Aug 9, 2023Updated 2 years ago
- β18Aug 24, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient β’ AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Notes on some important deep learning topics and paper summariesβ13Dec 16, 2020Updated 5 years ago
- zero-vocab or low-vocab embeddingsβ18Jul 17, 2022Updated 3 years ago
- A fusion of a linear layer and a cross entropy loss, written for pytorch in triton.β75Aug 2, 2024Updated last year
- BFloat16 Fused Adam Operator for PyTorchβ19Nov 16, 2024Updated last year
- Code associated to papers on superposition (in ML interpretability)β38Sep 13, 2022Updated 3 years ago
- Code for the note "NF4 Isn't Information Theoretically Optimal (and that's Good)β21Jun 22, 2023Updated 2 years ago
- Code for the paper "Function-Space Learning Rates"β25Jun 3, 2025Updated 10 months ago
- β17Dec 12, 2023Updated 2 years ago
- LIGHTVOC AN UPSAMPLING-FREE GAN VOCODER BASED ON CONFORMER AND INVERSE SHORT-TIME FOURIER TRANSFORMβ18May 17, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways β’ AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/β¦β29Apr 17, 2024Updated 2 years ago
- Variational Autoencoder with non-euclidean (hyperbolic) latent spaceβ12Nov 25, 2022Updated 3 years ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.β46Jul 17, 2024Updated last year
- A repo based on XiLin Li's PSGD repo that extends some of the experiments.β14Oct 7, 2024Updated last year
- Unsupervised Rhythm Modeling for Voice Conversionβ85Aug 3, 2023Updated 2 years ago
- A scalable implementation of diffusion and flow-matching with XGBoost models, applied to calorimeter data.β19Mar 23, 2026Updated 3 weeks ago
- Optimized Utilities for PyTorchβ26Jan 19, 2020Updated 6 years ago
- Calculating Expected Time for training LLM.β39Apr 17, 2023Updated 3 years ago
- This is the official repo for "S3D: Single Shot multi-Span Detector via Fully 3D Convolutional Network"β15Jan 23, 2019Updated 7 years ago
- Managed Kubernetes at scale on DigitalOcean β’ AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Audio Demo for "FastSVC: Fast Cross-Domain Singing Voice Conversion with Feature-wise Linear Modulation"β21Apr 7, 2021Updated 5 years ago
- High performance pytorch modulesβ18Jan 14, 2023Updated 3 years ago
- source code of EfficientTTS 2β20Feb 18, 2024Updated 2 years ago
- β68Mar 21, 2025Updated last year
- TPUμμ νκ΅μ΄μ© LLM μΆλ‘ μ μν Jax/Flax ꡬν체μ λλ€.β12Jun 12, 2023Updated 2 years ago
- Landing Page for Divide and Remaster v3β26Jul 29, 2025Updated 8 months ago
- a model zooβ11Jul 19, 2017Updated 8 years ago
- Instruction Following Evalβ16Jan 16, 2025Updated last year
- Please visit https://github.com/HKUSTDial/NL2SQL360 to get the official code!β10Sep 1, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI β’ AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- β16Jan 3, 2023Updated 3 years ago
- A sample app to debug and validate cellular modems on balena devicesβ13Jun 5, 2019Updated 6 years ago
- Multipack distributed sampler for fast padding-free training of LLMsβ207Aug 10, 2024Updated last year
- React 0.13 with ES6, Immutable.js and Flux, Isomorphic as wellβ11Mar 10, 2015Updated 11 years ago
- Android support library for use Indexed Bitmap(8 bits per pixel).β12Jun 22, 2017Updated 8 years ago
- Like word2vec, except for letters of the alphabet.β17May 29, 2017Updated 8 years ago
- Copying Garbage Collectorβ14May 13, 2020Updated 5 years ago