amazon-science / mxfp4-llmView external linksLinks
Official implementation for Training LLMs with MXFP4
☆118Apr 25, 2025Updated 9 months ago
Alternatives and similar repositories for mxfp4-llm
Users that are interested in mxfp4-llm are comparing it to the libraries listed below
Sorting:
- ☆119Jan 8, 2026Updated last month
- ☆46May 20, 2025Updated 8 months ago
- PyTorch emulation library for Microscaling (MX)-compatible data formats☆340Jun 18, 2025Updated 7 months ago
- Work in progress.☆79Nov 25, 2025Updated 2 months ago
- A framework to compare low-bit integer and float-point formats☆66Feb 6, 2026Updated last week
- JoVA: Unified Multimodal Learning for Joint Video-Audio Generation☆30Dec 22, 2025Updated last month
- [ICML 2025] MxMoE: Mixed-precision Quantization for MoE with Accuracy and Performance Co-Design☆22Jul 4, 2025Updated 7 months ago
- Concise Reasoning via Reinforcement Learning☆13Apr 16, 2025Updated 9 months ago
- All-in-one repository for Fine-tuning & Pretraining (Large) Language Models☆15Mar 8, 2023Updated 2 years ago
- Code for the paper “Four Over Six: More Accurate NVFP4 Quantization with Adaptive Block Scaling”☆122Updated this week
- ☆16Jul 16, 2024Updated last year
- Ongoing research training transformer models at scale☆18Feb 5, 2026Updated last week
- Pytorch implementation of the Gato paper from Deepmind☆12Feb 8, 2023Updated 3 years ago
- ☆15Sep 22, 2024Updated last year
- ☆14May 3, 2022Updated 3 years ago
- Why Low-Precision Transformer Training Fails: An Analysis on Flash Attention☆44Oct 16, 2025Updated 3 months ago
- VC-FB and MC-FB algorithms from "Zero-Shot Reinforcement Learning from Low Quality Data" (NeurIPS 2024)☆22Jan 14, 2025Updated last year
- ☆21Apr 2, 2025Updated 10 months ago
- ☆16Sep 12, 2024Updated last year
- ☆15Mar 1, 2022Updated 3 years ago
- ☆39Dec 19, 2025Updated last month
- Multiple GEMM operators are constructed with cutlass to support LLM inference.☆20Aug 3, 2025Updated 6 months ago
- Code for ACL 2023 Paper: ACLM: A Selective-Denoising based Generative Data Augmentation Approach for Low-Resource Complex NER☆21Jul 19, 2023Updated 2 years ago
- PoE-World: Compositional World Modeling with Products of Programmatic Experts☆39Feb 5, 2026Updated last week
- Contains my experiments with the `big_vision` repo to train ViTs on ImageNet-1k.☆22Jan 16, 2023Updated 3 years ago
- ☆17Dec 16, 2022Updated 3 years ago
- YAST - Yet Another SPLADE or Sparse Trainer☆21Jun 16, 2025Updated 7 months ago
- 한국어 자연어 처리 모델 미세조정☆17Jan 26, 2021Updated 5 years ago
- 📄Small Batch Size Training for Language Models☆80Oct 4, 2025Updated 4 months ago
- Code of the Paper "Time-Efficient Reinforcement Learning with Stochastic Stateful Policies"☆25May 5, 2024Updated last year
- ☆19Sep 20, 2022Updated 3 years ago
- Mitigating Partial Observability in Sequential Decision Processes via the Lambda Discrepancy☆23Oct 28, 2024Updated last year
- FireQ: Fast INT4-FP8 Kernel and RoPE-aware Quantization for LLM Inference Acceleration☆20Jun 27, 2025Updated 7 months ago
- ☆22Apr 12, 2022Updated 3 years ago
- new optimizer☆20Aug 4, 2024Updated last year
- This repository is the official implementation of the TRAC optimizer in Fast TRAC: A Parameter-Free Optimizer for Lifelong Reinforcement …☆32May 2, 2025Updated 9 months ago
- QuTLASS: CUTLASS-Powered Quantized BLAS for Deep Learning☆165Nov 11, 2025Updated 3 months ago
- ☆59Mar 3, 2025Updated 11 months ago
- Google's Conceptual Captions Dataset translated into Korean☆23Aug 28, 2022Updated 3 years ago