[ICML 2026 Spotlight] Official implementation of TetraJet-v2: Accurate NVFP4 Training for LLMs, with fully-NVFP4 linear layer with unbiased backprop, and algorithms to overcome LLMs' weight-oscillation and activation-outlier bottlenecks.
☆16Jul 3, 2026Updated 2 months ago
Alternatives and similar repositories for TetraJet-v2-NVFP4Training
Users that are interested in TetraJet-v2-NVFP4Training are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Pytorch implementation of "Oscillation-Reduced MXFP4 Training for Vision Transformers" on DeiT Model Pre-training☆41May 4, 2026Updated 4 months ago
- Code for "Accelerating Transformer Pre-training with 2:4 Sparsity"☆28Dec 8, 2024Updated last year
- ☆63Jul 21, 2024Updated 2 years ago
- StelLA: Subspace Learning in Low-rank Adaptation using Stiefel Manifold (NeurIPS 2025 Spotlight)☆19Jun 29, 2026Updated 2 months ago
- Auto math prover.☆10Jul 10, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Website for CSE 234, Winter 2025☆16Mar 24, 2025Updated last year
- ☆128Mar 18, 2026Updated 5 months ago
- Spectral Sphere Optimizer☆133Mar 23, 2026Updated 5 months ago
- ☆17Dec 9, 2024Updated last year
- [ICLR2026] The open-source code for FlowCache, including accelerated implementations of the MAGI-1 and Skyreels-V2.☆33Apr 24, 2026Updated 4 months ago
- Code for "DeepPolar codes", ICML 2024☆12May 7, 2024Updated 2 years ago
- [Neurips 2022] “ Back Razor: Memory-Efficient Transfer Learning by Self-Sparsified Backpropogation”, Ziyu Jiang*, Xuxi Chen*, Xueqin Huan…☆19Mar 14, 2023Updated 3 years ago
- ☆14Jan 3, 2025Updated last year
- Efficient 2:4 sparse training algorithms and implementations☆63Dec 8, 2024Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training☆266Aug 9, 2025Updated last year
- Code for Accelerated Linearized Laplace Approximation for Bayesian Deep Learning (ELLA, NeurIPS 22')☆17Oct 12, 2022Updated 3 years ago
- Quartet II Official Code☆82May 1, 2026Updated 4 months ago
- DeepSelect: TopK kernels for DeepSeek Sparse Attention (DSA) and Samplers☆300Updated this week
- RobuQ: Pushing DiTS to W1.58A2 via Robust Activation Quantization☆17Jun 28, 2026Updated 2 months ago
- 简易 OI 交题服务器☆11Dec 12, 2025Updated 9 months ago
- ☆17May 1, 2026Updated 4 months ago
- [ICML 2026] Residual Context Diffusion (RCD): Repurposing discarded signals as structured priors for high-performance reasoning in dLLMs.☆61Jun 28, 2026Updated 2 months ago
- Work in progress.☆82Nov 25, 2025Updated 9 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Official Codebase for "Aligning Diffusion Behaviors with Q-functions for Efficient Continuous Control" (NeurIPS 2024)☆15Oct 29, 2024Updated last year
- Mirror Diffusion Models, NeurIPS 2023☆33Dec 1, 2023Updated 2 years ago
- APAR: LLMs Can Do Auto-Parallel Auto-Regressive Decoding☆14Jul 22, 2024Updated 2 years ago
- PyTorch implementation for "Probabilistic Circuits for Variational Inference in Discrete Graphical Models", NeurIPS 2020☆17Oct 11, 2021Updated 4 years ago
- [ICML 2026] Q-DiT4SR: Exploration of Detail-Preserving Diffusion Transformer Quantization for Real-World Image Super-Resolution☆23May 1, 2026Updated 4 months ago
- Source code for paper Conservative Uncertainty Estimation By Fitting Prior Networks (ICLR 2020)☆22Nov 28, 2022Updated 3 years ago
- Official Pytorch Implementation of "Outlier-weighed Layerwise Sampling for LLM Fine-tuning" by Pengxiang Li, Lu Yin, Xiaowei Gao, Shiwei …☆35Jun 3, 2025Updated last year
- [WACV 2025 ORAL] Official Pytorch Code for DragText: Rethinking Text Embedding in Point-based Image Editing☆14Jan 22, 2025Updated last year
- 🧂 [ECCV 2026] Salt: Self-Consistent Distribution Matching with Cache-Aware Training for Fast Video Generation☆21Aug 24, 2026Updated 2 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Python scripts for our model described in http://proceedings.mlr.press/v130/ramchandran21b.html☆17Jun 17, 2021Updated 5 years ago
- ☆57Mar 14, 2025Updated last year
- On Uncertainty, Tempering, and Data Augmentation in Bayesian Classification☆21Apr 1, 2022Updated 4 years ago
- Code Repository for the NeurIPS 2022 paper: "Hyper-Representations as Generative Models: Sampling Unseen Neural Network Weights".☆19Jul 10, 2024Updated 2 years ago
- ☆13Feb 11, 2019Updated 7 years ago
- Official implementation of Progressive Tempering Sampler with Diffusion (ICML 2025)☆16Aug 16, 2025Updated last year
- ☆35Aug 14, 2026Updated 3 weeks ago