arogozhnikov/adamw_bfloat16 external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

arogozhnikov/adamw_bfloat16

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/arogozhnikov/adamw_bfloat16)

Close

arogozhnikov / adamw_bfloat16View on GitHubMore

• External links
• Readme badge

AdamW optimizer for bfloat16 models in pytorch 🔥.

☆40Jun 16, 2024Updated 2 years ago

Alternatives and similar repositories for adamw_bfloat16

Users that are interested in adamw_bfloat16 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• AlxSp / t-jepa

  View on GitHub
  ☆12Apr 26, 2024Updated 2 years ago
• AI-Northstar-Tech / openai-proxy

  View on GitHub
  Proxy server for quota, usage monitoring and tracking of OpenAI requests
  ☆16Sep 21, 2023Updated 2 years ago
• GallagherCommaJack / pdf2md

  View on GitHub
  ☆16Dec 30, 2024Updated last year
• MaxMax2016 / Glow-SVC

  View on GitHub
  4G GPU & 10 Minutes for train
  ☆12Aug 9, 2023Updated 2 years ago
• GallagherCommaJack / modulax

  View on GitHub
  ☆18Aug 24, 2024Updated last year
• Managed Kubernetes at scale on DigitalOcean • Ad
  DigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
• RichardGanaye / Cox-Galois-Theory-Exercises

  View on GitHub
  Exercises Galois theory D. Cox
  ☆13Jun 29, 2023Updated 2 years ago
• ChenghaoMou / embeddings

  View on GitHub
  zero-vocab or low-vocab embeddings
  ☆18Jul 17, 2022Updated 3 years ago
• bentherien / mu_learned_optimization

  View on GitHub
  [Poster; ICLR 2026] [Oral; Neurips OPT2024] μLO: Compute-Efficient Meta-Generalization of Learned Optimizers
  ☆16Apr 15, 2026Updated 2 months ago
• JonasGeiping / linear_cross_entropy_loss

  View on GitHub
  A fusion of a linear layer and a cross entropy loss, written for pytorch in triton.
  ☆75Aug 2, 2024Updated last year
• wattenberg / superposition

  View on GitHub
  Code associated to papers on superposition (in ML interpretability)
  ☆40Sep 13, 2022Updated 3 years ago
• taki0112 / SDIT-Tensorflow

  View on GitHub
  Simple Tensorflow implementation of "SDIT: Scalable and Diverse Cross-domain Image Translation" (ACM-MM 2019)
  ☆16Oct 14, 2019Updated 6 years ago
• slp-rl / SpokenStoryCloze

  View on GitHub
  A spoken version of the textual story cloze benchmark
  ☆22Aug 6, 2023Updated 2 years ago
• scf4 / OpenMusicLM

  View on GitHub
  Update: Ignore this repo, check out @lucidrains' implementation https://github.com/lucidrains/musiclm-pytorch
  ☆15Jan 27, 2023Updated 3 years ago
• davisyoshida / abnormal-floats

  View on GitHub
  Code for the note "NF4 Isn't Information Theoretically Optimal (and that's Good)
  ☆21Jun 22, 2023Updated 2 years ago
• Open source password manager - Proton Pass • Ad
  Securely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
• davzha / multiset-equivariance

  View on GitHub
  ☆14Apr 7, 2022Updated 4 years ago
• huutuongtu / Lightvoc

  View on GitHub
  LIGHTVOC AN UPSAMPLING-FREE GAN VOCODER BASED ON CONFORMER AND INVERSE SHORT-TIME FOURIER TRANSFORM
  ☆18May 17, 2024Updated 2 years ago
• julian-8897 / hyperbolic-latent-vae

  View on GitHub
  Variational Autoencoder with non-euclidean (hyperbolic) latent space
  ☆13Nov 25, 2022Updated 3 years ago
• CODEJIN / XiaoiceSing2

  View on GitHub
  ☆19Feb 2, 2023Updated 3 years ago
• graphcore-research / out-of-the-box-fp8-training

  View on GitHub
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆46Jul 17, 2024Updated last year
• opooladz / Preconditioned-Stochastic-Gradient-Descent

  View on GitHub
  A repo based on XiLin Li's PSGD repo that extends some of the experiments.
  ☆14Oct 7, 2024Updated last year
• bitswired / semantic-caching

  View on GitHub
  Explore semantic caching to reduce your OpenAI/LLM API bill
  ☆11Jul 21, 2023Updated 2 years ago
• crowsonkb / torch-dist-utils

  View on GitHub
  Utilities for PyTorch distributed
  ☆25Feb 27, 2025Updated last year
• seaniezhao / cnnpss

  View on GitHub
  A Chinese version of A Neural Parametric Singing Synthesizer
  ☆13Feb 12, 2022Updated 4 years ago
• Managed Kubernetes at scale on DigitalOcean • Ad
  DigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
• wbaek / torchskeleton

  View on GitHub
  Optimized Utilities for PyTorch
  ☆26Jan 19, 2020Updated 6 years ago
• senzanome75 / prompt-expander

  View on GitHub
  A Prompt Expander OpenAI-Based.
  ☆14Nov 15, 2023Updated 2 years ago
• mgmalek / efficient_cross_entropy

  View on GitHub
  ☆125May 28, 2024Updated 2 years ago
• deep-diver / hllama

  View on GitHub
  hllama is a library which aims to provide a set of utility tools for large language models.
  ☆10Apr 16, 2024Updated 2 years ago
• jason9693 / ETA4LLMs

  View on GitHub
  Calculating Expected Time for training LLM.
  ☆39Apr 17, 2023Updated 3 years ago
• ddollar / anvil

  View on GitHub
  Generic build server
  ☆65May 25, 2014Updated 12 years ago
• nobody996 / FastSVC

  View on GitHub
  Audio Demo for "FastSVC: Fast Cross-Domain Singing Voice Conversion with Feature-wise Linear Modulation"
  ☆21Apr 7, 2021Updated 5 years ago
• bennettjustin / AirFlag

  View on GitHub
  Detect nearby AirTags in disconnected or lost modes.
  ☆10Feb 3, 2022Updated 4 years ago
• nboyd / joltz

  View on GitHub
  JAX translation of boltz
  ☆28Aug 4, 2025Updated 10 months ago
• Deploy open-source AI quickly and easily - Special Bonus Offer • Ad
  Runpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
• ClashLuke / PerfTorch

  View on GitHub
  High performance pytorch modules
  ☆18Jan 14, 2023Updated 3 years ago
• playXE / garbage-collector

  View on GitHub
  Garbage collector implementation in Rust for Rust
  ☆13Aug 30, 2020Updated 5 years ago
• mcf330 / efts2code

  View on GitHub
  source code of EfficientTTS 2
  ☆21Feb 18, 2024Updated 2 years ago
• affjljoo3581 / polyglot-jax-inference

  View on GitHub
  TPU에서 한국어용 LLM 추론을 위한 Jax/Flax 구현체입니다.
  ☆12Jun 12, 2023Updated 3 years ago
• kyleliang919 / Super_Muon

  View on GitHub
  ☆69Mar 21, 2025Updated last year
• kwatcharasupat / divide-and-remaster-v3

  View on GitHub
  Landing Page for Divide and Remaster v3
  ☆26Jul 29, 2025Updated 10 months ago
• i-machine-think / emergent_grammar_induction

  View on GitHub
  A toolkit for finding and analysing the grammars of emergent languages.
  ☆11Nov 16, 2020Updated 5 years ago