Efficient kernel for RMS normalization with fused operations, includes both forward and backward passes, compatibility with PyTorch.
☆13Jun 5, 2024Updated 2 years ago
Alternatives and similar repositories for Tri-RMSNorm
Users that are interested in Tri-RMSNorm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆10Apr 7, 2025Updated last year
- A novel temporal fusion framework for propelling autoregressive model inference☆11Updated this week
- ☆12Mar 16, 2022Updated 4 years ago
- PyTorch Code for the Paper: "Exploiting Uncertainty of Loss Landscape for Stochastic Optimization [Bhaskara et al. (2019)]☆16Apr 30, 2026Updated 6 months ago
- ☆14Aug 28, 2019Updated 7 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Forge-CuTe-Py: A PyTorch-native CuTe DSL kernel laboratory for correctness, benchmarking, and profiling.☆13Feb 8, 2026Updated 8 months ago
- A peer-to-peer database in Rust☆11Oct 24, 2023Updated 3 years ago
- ☆14Oct 31, 2023Updated 3 years ago
- ☆15Apr 26, 2022Updated 4 years ago
- kernelboard is the webapp for https://www.gpumode.com☆20Updated this week
- Starlight: A Kernel Optimizer for GPU Processing☆17Jan 10, 2024Updated 2 years ago
- Bleeding edge low level Rust binding for GGML☆18Jun 26, 2024Updated 2 years ago
- Compressing token embeddings for transformer-based language models using a novel orientation-based loss objective (accepted to RepL4NLP w…☆10Sep 21, 2022Updated 4 years ago
- Jax implementation of the AdaHessian optimizer☆19Mar 11, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Life before `main()`☆19Feb 2, 2021Updated 5 years ago
- multi-master-paxos with 3 nodes☆14Apr 11, 2022Updated 4 years ago
- Parsing and serialization support for PSSH boxes used in DRM systems☆16Jul 24, 2026Updated 3 months ago
- ☆10Nov 26, 2025Updated 11 months ago
- A collection of optimizers, some arcane others well known, for Flax.☆29Aug 6, 2021Updated 5 years ago
- Implementation of "Brain-Inspired Warm-Up Training with Random Noise for Uncertainty Calibration" (Cheon and Paik, Nat. Mach. Intell., 20…☆14Feb 22, 2026Updated 8 months ago
- ☆14Aug 7, 2026Updated 2 months ago
- Deep Learning CNN using FastAI for the Stanford MRNet Knee MRI diagnosis challenge☆16May 18, 2019Updated 7 years ago
- ☆17Dec 11, 2022Updated 3 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆26Mar 15, 2023Updated 3 years ago
- Sparsity as a Variance Regulator for Improved Depth Utilization in Language Models☆16May 11, 2026Updated 5 months ago
- ☆23Jan 23, 2024Updated 2 years ago
- ☆10Mar 29, 2022Updated 4 years ago
- Implementation of the dilated self attention as described in "LongNet: Scaling Transformers to 1,000,000,000 Tokens"☆13Jul 23, 2023Updated 3 years ago
- Implemented and benchmarked KV cache compression methods for LLM inference in Triton. Optimized kernels for KIVI and TurboQuant with Flas…☆18Jun 19, 2026Updated 4 months ago
- FlashPrefill V2: Block-Sparse Prefill Attention for Long-Context LLM Serving☆32Aug 28, 2026Updated 2 months ago
- PyTorch implementation of "MLP-Mixer: An all-MLP Architecture for Vision" Tolstikhin et al. (2021)☆31May 13, 2021Updated 5 years ago
- A list of papers I read.☆12Nov 19, 2023Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- a collection of CUDA Kernels☆18Jul 24, 2026Updated 3 months ago
- some mixture of experts architecture implementations☆28Mar 22, 2024Updated 2 years ago
- FaceCat捂脸猫框架是一款跨平台跨语言的图形和通信服务框架，主要由矿洞程序员陶德制作。该框架有C++，C#，Java三个语言版本，支持在Windows，iOS，Android，MacOS，Linux上运行。该框架已经开源，协议为BSD，当前开放版本仅为底层框架，尚未包含…☆15May 26, 2019Updated 7 years ago
- ☆20Jun 13, 2025Updated last year
- ☆32Jan 7, 2024Updated 2 years ago
- This is docker images of Ubuntu 14.04 LTS with apache2 and php5☆22Dec 8, 2021Updated 4 years ago
- Fast and trainable tokenizer for natural languages relying on maximum entropy methods.☆22May 2, 2017Updated 9 years ago