CroissAttn: FP4 attention forward and backward, with analysis of stochastic rounding, zero-sum softmax gradients, and sampled centering.
☆16Oct 25, 2026Updated 3 weeks ago
Alternatives and similar repositories for fp4Attn
Users that are interested in fp4Attn are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆44Oct 5, 2026Updated last month
- 🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.☆14Oct 1, 2026Updated last month
- ☆49Oct 24, 2026Updated 3 weeks ago
- W4A16 MoE GEMM CUDA kernel. Tuned for H200, B200 & B300.☆14Oct 30, 2026Updated 3 weeks ago
- Breaking the quadratic memory barrier in AI☆60Oct 13, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [Tech Report] On the Design of Hyper-Connections: Simplification, Stability, and Scalability. The fastest Hyper-Connections method with c…☆21Nov 8, 2026Updated last week
- Official code base for la LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixels extended to also learn late…☆15Apr 9, 2026Updated 7 months ago
- Lua/WASM Actor platform☆15Updated this week
- Why Low-Precision Transformer Training Fails: An Analysis on Flash Attention☆84Apr 7, 2026Updated 7 months ago
- ALIKED LightGlue ONNX inference☆19Feb 21, 2025Updated last year
- [ICML 2025] Differentiable Solver Search for Fast Diffusion Sampling☆21Jul 7, 2025Updated last year
- ☆81Oct 18, 2026Updated last month
- Surgical GPU kernel benchmark: 7 hard problems, frontier coding agents, roofline-graded against hardware peak.☆19Jun 12, 2026Updated 5 months ago
- ☆23Nov 3, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- VideoAtlas/VideoRLM: Navigating Long-Form Video in Logarithmic Compute☆22May 19, 2026Updated 6 months ago
- ☆12May 8, 2026Updated 6 months ago
- ☆27Jul 13, 2026Updated 4 months ago
- Personal knowledge vault plugin for Claude Code — session recording, memory distillation, and hybrid semantic + BM25 retrieval.☆25Updated this week
- [CVPR2026] LeapAlign: Post-Training Flow Matching Models at Any Generation Step by Building Two-Step Trajectories☆61Jun 13, 2026Updated 5 months ago
- LUCID: Attention with Preconditioned Representations - A novel attention mechanism for improved long-context retrieval in Transformers☆13May 29, 2026Updated 5 months ago
- Artifacts for SWARM: Replicating Shared Disaggregated-Memory Data in No Time☆10Sep 25, 2024Updated 2 years ago
- 面向多平台编译优化的深度学习中间表示☆10Oct 28, 2024Updated 2 years ago
- HDF5 Cache VOL connector for caching data on fast storage layers and moving data asynchronously to the parallel file system to hide I/O o…☆22Feb 10, 2026Updated 9 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- “Classical Energies Learn to Reason 1,000× Faster than Looped Models” (CRAM) by Benjamin Hoover, Hugh Blayney, and James C. R. Whittingto…☆19Updated this week
- Scripts and config files for SLURM☆13Sep 12, 2025Updated last year
- Implementation of LatentMoE,Toward Optimal Accuracy per FLOP and Parameter in Mixture of Experts (Elango et al., NVIDIA 2026) — in Pytorc…☆27Jul 22, 2026Updated 3 months ago
- ☆16Jul 14, 2026Updated 4 months ago
- ☆10Dec 8, 2021Updated 4 years ago
- cuda best practice & notes☆10Oct 24, 2025Updated last year
- Collection of Deep Learning Jupyter Notebooks. Each notebook is self-contained and presents single architecture. These include MLPs, CNNs…☆13Aug 7, 2021Updated 5 years ago
- Persistent Memory Tool Box☆12Mar 4, 2024Updated 2 years ago
- Synchronizing Claude Code conversations across machines☆16Sep 30, 2026Updated last month
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- [NeurIPS 2025, Spotlight]: Ambient-o: Training Good models with Bad Data.☆36Jul 2, 2026Updated 4 months ago
- (elastic) cuckoo hashing☆17Jun 20, 2020Updated 6 years ago
- Slides and exercises for persistent memory programming tutorial☆14Nov 14, 2022Updated 4 years ago
- ☆14Sep 30, 2026Updated last month
- ☆13Oct 11, 2026Updated last month
- A tool for coordinated checkpoint/restore of distributed applications with CRIU☆36Jul 31, 2026Updated 3 months ago
- A differentiable JAX-based framework for vertex modeling and inverse design of epithelial tissues☆26Jul 30, 2026Updated 3 months ago
Are these results useful?