[ICML 2026 Spotlight] Official implementation of TetraJet-v2: Accurate NVFP4 Training for LLMs, with fully-NVFP4 linear layer with unbiased backprop, and algorithms to overcome LLMs' weight-oscillation and activation-outlier bottlenecks.
☆15Jul 3, 2026Updated last week
Alternatives and similar repositories for TetraJet-v2-NVFP4Training
Users that are interested in TetraJet-v2-NVFP4Training are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Pytorch implementation of "Oscillation-Reduced MXFP4 Training for Vision Transformers" on DeiT Model Pre-training☆40May 4, 2026Updated 2 months ago
- Code for "Accelerating Transformer Pre-training with 2:4 Sparsity"☆28Dec 8, 2024Updated last year
- Website for CSE 234, Winter 2025☆16Mar 24, 2025Updated last year
- ☆63Jul 21, 2024Updated last year
- Don't just regulate gradients like in Muon, regulate the weights too☆32Jul 30, 2025Updated 11 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Auto math prover.☆10Jul 10, 2024Updated 2 years ago
- ☆17Dec 9, 2024Updated last year
- The official code of Multi-player Nash Preference Optimization [ICLR 2026]☆35Feb 4, 2026Updated 5 months ago
- [Neurips 2022] “ Back Razor: Memory-Efficient Transfer Learning by Self-Sparsified Backpropogation”, Ziyu Jiang*, Xuxi Chen*, Xueqin Huan…☆19Mar 14, 2023Updated 3 years ago
- PyTorch Implementation of Variance Reduced Optimization Algorithms -- SARAH and SVRG.☆15Jul 11, 2021Updated 5 years ago
- Official Codebase for "Aligning Diffusion Behaviors with Q-functions for Efficient Continuous Control" (NeurIPS 2024)☆15Oct 29, 2024Updated last year
- Code for "DeepPolar codes", ICML 2024☆12May 7, 2024Updated 2 years ago
- ☆53May 16, 2026Updated last month
- Asynchronous pipeline parallel optimization☆22Feb 2, 2026Updated 5 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Code Repository for the NeurIPS 2022 paper: "Hyper-Representations as Generative Models: Sampling Unseen Neural Network Weights".☆18Jul 10, 2024Updated 2 years ago
- VGDFR: Diffuison-based Video Generation with Dynamic Frame Rate☆18May 16, 2025Updated last year
- ☆20Mar 11, 2025Updated last year
- Fast Hadamard transform in CUDA, with a PyTorch interface☆337Mar 10, 2026Updated 4 months ago
- Code release for "Generative Modeling of Weights: Generalization or Memorization?"☆23Apr 9, 2026Updated 3 months ago
- [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training☆263Aug 9, 2025Updated 11 months ago
- Efficient 2:4 sparse training algorithms and implementations☆62Dec 8, 2024Updated last year
- [ICLR25] STBLLM: Breaking the 1-Bit Barrier with Structured Binary LLMs☆20Jun 3, 2025Updated last year
- Code for Accelerated Linearized Laplace Approximation for Bayesian Deep Learning (ELLA, NeurIPS 22')☆17Oct 12, 2022Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆17May 1, 2026Updated 2 months ago
- Official codes for Scalable Infomin Learning, NeurIPS 2022☆14Feb 28, 2023Updated 3 years ago
- [𝗜𝗖𝗠𝗟 𝟮𝟬𝟮𝟲] Dispersion loss counteracts embedding condensation and improves generalization in small language models☆15May 21, 2026Updated last month
- ☆27Oct 1, 2025Updated 9 months ago
- Summer Training 2024, SAST 9.☆15Aug 17, 2024Updated last year
- Mirror Diffusion Models, NeurIPS 2023☆33Dec 1, 2023Updated 2 years ago
- [WACV 2025 ORAL] Official Pytorch Code for DragText: Rethinking Text Embedding in Point-based Image Editing☆14Jan 22, 2025Updated last year
- Official Pytorch Implementation of "Outlier-weighed Layerwise Sampling for LLM Fine-tuning" by Pengxiang Li, Lu Yin, Xiaowei Gao, Shiwei …☆35Jun 3, 2025Updated last year
- Share your GPU without MIG or MPS☆50Jan 27, 2026Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆10Nov 18, 2024Updated last year
- Parallel Self-Adjusting Computation☆16Jul 5, 2021Updated 5 years ago
- PyTorch implementation for "Probabilistic Circuits for Variational Inference in Discrete Graphical Models", NeurIPS 2020☆17Oct 11, 2021Updated 4 years ago
- ☆52Mar 14, 2025Updated last year
- [ICLR 2026] BARREL: Boundary-Aware Reasoning for Factual and Reliable LRMs☆18May 21, 2025Updated last year
- CI scripts designed to build a Pascal-compatible version of vLLM.☆13Aug 10, 2024Updated last year
- An interpretable progression model for high-dimensional neuroimaging data.☆17Jul 13, 2023Updated 3 years ago