[ICML 2026 Spotlight] Official implementation of TetraJet-v2: Accurate NVFP4 Training for LLMs, with fully-NVFP4 linear layer with unbiased backprop, and algorithms to overcome LLMs' weight-oscillation and activation-outlier bottlenecks.
☆19Jul 3, 2026Updated 4 months ago
Alternatives and similar repositories for TetraJet-v2-NVFP4Training
Users that are interested in TetraJet-v2-NVFP4Training are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Pytorch implementation of "Oscillation-Reduced MXFP4 Training for Vision Transformers" on DeiT Model Pre-training☆41May 4, 2026Updated 6 months ago
- Quantization-Aware Training for NVFP4 Reasoning Models☆14Jul 10, 2026Updated 4 months ago
- [NeurIPS 2026] Low-Rank Latent KV Cache for Minute-Scale Autoregressive Video Diffusion☆21Sep 25, 2026Updated last month
- An external memory allocator example for PyTorch.☆16Aug 10, 2025Updated last year
- Efficient 2:4 sparse training algorithms and implementations☆63Dec 8, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Code for "Accelerating Transformer Pre-training with 2:4 Sparsity"☆28Dec 8, 2024Updated last year
- Quartet II Official Code☆85May 1, 2026Updated 6 months ago
- ☆64Jul 21, 2024Updated 2 years ago
- [ICLR2026] The open-source code for FlowCache, including accelerated implementations of the MAGI-1 and Skyreels-V2.☆35Apr 24, 2026Updated 6 months ago
- ☆53May 20, 2025Updated last year
- ☆13May 20, 2026Updated 5 months ago
- StelLA: Subspace Learning in Low-rank Adaptation using Stiefel Manifold (NeurIPS 2025 Spotlight)☆21Jun 29, 2026Updated 4 months ago
- Website for CSE 234, Winter 2025☆16Mar 24, 2025Updated last year
- [NeurIPS 2026] POME: Post Optimization Model Edit via Muon-style Projection☆14Oct 9, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆11Aug 26, 2024Updated 2 years ago
- Auto math prover.☆10Jul 10, 2024Updated 2 years ago
- Step-by-step GEMM optimization, one hardware feature at a time. High performance CuTeDSL kernels for H100, B200 and RTX 50s GPUs. This re…☆23May 14, 2026Updated 5 months ago
- Awesome MoE Diffusion Models☆21Mar 25, 2026Updated 7 months ago
- ☆13Mar 10, 2026Updated 8 months ago
- Modular and extensible open source GenAI engine☆14Apr 28, 2026Updated 6 months ago
- Official implementation for Training LLMs with MXFP4☆131Apr 25, 2025Updated last year
- ☆12Jan 30, 2026Updated 9 months ago
- ☆130Mar 18, 2026Updated 7 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Samplers from the paper "Stochastic Gradient MCMC with Repulsive Forces"☆11Feb 3, 2020Updated 6 years ago
- ☆17Dec 9, 2024Updated last year
- An Fast variant calling tool to detection germline and somatic variants☆12Feb 21, 2026Updated 8 months ago
- [Neurips 2022] “ Back Razor: Memory-Efficient Transfer Learning by Self-Sparsified Backpropogation”, Ziyu Jiang*, Xuxi Chen*, Xueqin Huan…☆19Mar 14, 2023Updated 3 years ago
- Validation of sycnmers compared to minimizers☆11May 10, 2025Updated last year
- Make FP4 on 5090 Great Again☆24Jul 20, 2026Updated 3 months ago
- Evidence-based dynamic analysis: a fast checker for memory errors.☆21Apr 22, 2017Updated 9 years ago
- Fast Hadamard transform in CUDA, with a PyTorch interface☆357Mar 10, 2026Updated 8 months ago
- RabbitKSSD: accelerating genome distance estimation on modern multi-core architectures☆12Jun 5, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- An official implementation of FlashI2V.☆35Nov 16, 2025Updated 11 months ago
- The official code implement of <Nexus: Same Pretraining Loss, Better Downstream Generalization via Common Minima>☆19Jun 17, 2026Updated 4 months ago
- 简易 OI 交题服务器☆10Dec 12, 2025Updated 11 months ago
- [ICLR 2026] KVComm: Enabling Efficient LLM Communication through Selective KV Sharing☆21Jan 26, 2026Updated 9 months ago
- ☆11Oct 29, 2026Updated 2 weeks ago
- ☆24Jan 22, 2025Updated last year
- Work in progress.☆82Nov 25, 2025Updated 11 months ago
Are these results useful?