[ICML 2026 Spotlight] Official implementation of TetraJet-v2: Accurate NVFP4 Training for LLMs, with fully-NVFP4 linear layer with unbiased backprop, and algorithms to overcome LLMs' weight-oscillation and activation-outlier bottlenecks.
☆19Jul 3, 2026Updated 3 months ago
Alternatives and similar repositories for TetraJet-v2-NVFP4Training
Users that are interested in TetraJet-v2-NVFP4Training are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Pytorch implementation of "Oscillation-Reduced MXFP4 Training for Vision Transformers" on DeiT Model Pre-training☆41May 4, 2026Updated 5 months ago
- [NeurIPS 2026] Low-Rank Latent KV Cache for Minute-Scale Autoregressive Video Diffusion☆19Sep 25, 2026Updated 3 weeks ago
- Step-by-step GEMM optimization, one hardware feature at a time. High performance CuTeDSL kernels for H100, B200 and RTX 50s GPUs. This re…☆21May 14, 2026Updated 5 months ago
- Code for "Accelerating Transformer Pre-training with 2:4 Sparsity"☆28Dec 8, 2024Updated last year
- An external memory allocator example for PyTorch.☆16Aug 10, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆64Jul 21, 2024Updated 2 years ago
- Quartet II Official Code☆83May 1, 2026Updated 5 months ago
- ☆129Mar 18, 2026Updated 7 months ago
- An evidence-first story-to-video production engine.☆19Sep 29, 2026Updated 3 weeks ago
- Spectral Sphere Optimizer☆136Mar 23, 2026Updated 7 months ago
- Make FP4 on 5090 Great Again☆24Jul 20, 2026Updated 3 months ago
- ☆17Dec 9, 2024Updated last year
- ☆14Jan 3, 2025Updated last year
- [Neurips 2022] “ Back Razor: Memory-Efficient Transfer Learning by Self-Sparsified Backpropogation”, Ziyu Jiang*, Xuxi Chen*, Xueqin Huan…☆19Mar 14, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [ICLR2026] The open-source code for FlowCache, including accelerated implementations of the MAGI-1 and Skyreels-V2.☆34Apr 24, 2026Updated 5 months ago
- PyTorch Implementation of Variance Reduced Optimization Algorithms -- SARAH and SVRG.☆15Jul 11, 2021Updated 5 years ago
- Evidence-based dynamic analysis: a fast checker for memory errors.☆21Apr 22, 2017Updated 9 years ago
- Official implementation of "Perceptual Flow Matching for Few-Step Generative Modeling"☆32Aug 10, 2026Updated 2 months ago
- Fast Hadamard transform in CUDA, with a PyTorch interface☆354Mar 10, 2026Updated 7 months ago
- RobuQ: Pushing DiTS to W1.58A2 via Robust Activation Quantization☆17Oct 14, 2026Updated last week
- PHP程序设计课程大作业——基于PHP、MySQL的数码商城☆19Jul 13, 2021Updated 5 years ago
- Official codes for Scalable Infomin Learning, NeurIPS 2022☆14Feb 28, 2023Updated 3 years ago
- [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training☆268Aug 9, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Intelligent Data Analysis☆12Jul 24, 2018Updated 8 years ago
- A gem for converting between hiragana, katakana, and romaji alphabets for the Japanese language☆15Jan 18, 2023Updated 3 years ago
- Code and reproducibility artifacts for reconstructing megakernel persistence with CUDA PDL☆24Aug 5, 2026Updated 2 months ago
- Work in progress.☆82Nov 25, 2025Updated 10 months ago
- ☆12Nov 21, 2025Updated 11 months ago
- Stock Analysis System based on Spark, Kafka.☆10Dec 22, 2019Updated 6 years ago
- [ICML 2026] Residual Context Diffusion (RCD): Repurposing discarded signals as structured priors for high-performance reasoning in dLLMs.☆62Jun 28, 2026Updated 3 months ago
- Unofficial local OpenAI-compatible API for authenticated DeepSeek Web sessions☆33Updated this week
- Complete simulation of IEEE 754 fixed and floating point specification to any precision☆13Aug 26, 2020Updated 6 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [𝗜𝗖𝗠𝗟 𝟮𝟬𝟮𝟲] Dispersion loss counteracts embedding condensation and improves generalization in small language models☆21May 21, 2026Updated 5 months ago
- ☆17May 1, 2026Updated 5 months ago
- Official Codebase for "Aligning Diffusion Behaviors with Q-functions for Efficient Continuous Control" (NeurIPS 2024)☆15Oct 29, 2024Updated last year
- [ICML2026] Auto-Regressive Long Video Generation via 2-Bit KV-Cache Quantization☆66Jul 26, 2026Updated 2 months ago
- Official Pytorch Implementation of "Outlier-weighed Layerwise Sampling for LLM Fine-tuning" by Pengxiang Li, Lu Yin, Xiaowei Gao, Shiwei …☆35Jun 3, 2025Updated last year
- Pintos Operating Systems Project 3 (CIS 520).☆10May 9, 2017Updated 9 years ago
- [WACV 2025 ORAL] Official Pytorch Code for DragText: Rethinking Text Embedding in Point-based Image Editing☆14Jan 22, 2025Updated last year