A high-performance kernel library for LLM training
☆89Apr 28, 2026Updated 5 months ago
Alternatives and similar repositories for linghe
Users that are interested in linghe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Feb 26, 2026Updated 7 months ago
- Ring is a reasoning MoE LLM provided and open-sourced by InclusionAI, derived from Ling.☆108Aug 5, 2025Updated last year
- CUDA kernels for linear attention variants, written in CuTe DSL and CUTLASS C++.☆553Sep 20, 2026Updated last week
- Ling is a MoE LLM provided and open-sourced by InclusionAI.☆267May 14, 2025Updated last year
- Ling-V2 is a MoE LLM provided and open-sourced by InclusionAI.☆281Oct 4, 2025Updated 11 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- FA4-based Relative Attention Kernel developed by TML and Colfax☆18Sep 11, 2026Updated 3 weeks ago
- Ring-V2 is a reasoning MoE LLM provided and open-sourced by InclusionAI.☆99Oct 23, 2025Updated 11 months ago
- Humming is a high-performance, lightweight, and highly flexible JIT (Just-In-Time) compiled GEMM kernel library specifically designed for…☆241Updated this week
- Make FP4 on 5090 Great Again☆24Jul 20, 2026Updated 2 months ago
- Accelerating MoE with IO and Tile-aware Optimizations☆775Aug 29, 2026Updated last month
- Best practices for training DeepSeek, Mixtral, Qwen and other MoE models using Megatron Core.☆204May 29, 2026Updated 4 months ago
- The Newton-Muon optimizer☆33Jun 5, 2026Updated 3 months ago
- ☆28Feb 28, 2026Updated 7 months ago
- Muon fsdp 2☆65Aug 8, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Communication patterns for AI, built on top of NCCL device and host APIs☆66Updated this week
- ☆98Feb 5, 2026Updated 7 months ago
- All-in-one benchmarking platform for evaluating LLM.☆15Nov 12, 2025Updated 10 months ago
- A Multi-Policy, Multi-Agent RL Training Framework☆32Jun 16, 2026Updated 3 months ago
- A NCCL extension library, designed to efficiently offload GPU memory allocated by the NCCL communication library.☆119Dec 17, 2025Updated 9 months ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆46Jul 17, 2024Updated 2 years ago
- Production-ready MoE load balancing via real-time expert replication☆252Jul 17, 2026Updated 2 months ago
- ☆25Feb 27, 2026Updated 7 months ago
- A single-line modification to any (dualizer-based) optimizer that allows the optimizer to adapt to the scale of the gradients as they cha…☆19Jan 11, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆206Feb 11, 2026Updated 7 months ago
- Accelerate inference without tears☆369Jan 23, 2026Updated 8 months ago
- ☆52Mar 9, 2026Updated 6 months ago
- Fast and memory-efficient exact attention☆23Jun 26, 2026Updated 3 months ago
- FlashKDA: high-performance Kimi Delta Attention kernels☆1,264Sep 1, 2026Updated last month
- Skills for writing tilelang and debugging with CUDA toolkits.☆144Sep 15, 2026Updated 2 weeks ago
- ☆279Updated this week
- Expert Specialization MoE Solution based on CUTLASS☆27Apr 14, 2026Updated 5 months ago
- ☆47Feb 28, 2026Updated 7 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Muon in Int8 Precision Made Possible☆20Jun 18, 2026Updated 3 months ago
- An Optimizer for Nvidia Compilers.☆137Sep 23, 2026Updated last week
- Perplexity GPU Kernels☆608Nov 7, 2025Updated 10 months ago
- PyTorch bindings for CUTLASS grouped GEMM.☆155May 29, 2025Updated last year
- NCU-driven iterative optimization workflow for CUDA/CUTLASS/Triton/CuTe DSL kernels.☆25Apr 10, 2026Updated 5 months ago
- Fast Hadamard transform in CUDA, with a PyTorch interface☆349Mar 10, 2026Updated 6 months ago
- Codes for DATA: Differentiable ArchiTecture Approximation.☆11Jul 22, 2021Updated 5 years ago