A high-performance kernel library for LLM training
☆87Apr 28, 2026Updated 3 months ago
Alternatives and similar repositories for linghe
Users that are interested in linghe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Feb 26, 2026Updated 5 months ago
- Ring is a reasoning MoE LLM provided and open-sourced by InclusionAI, derived from Ling.☆109Aug 5, 2025Updated last year
- CUDA kernels for linear attention variants, written in CuTe DSL and CUTLASS C++.☆538Updated this week
- Ling is a MoE LLM provided and open-sourced by InclusionAI.☆268May 14, 2025Updated last year
- Ling-V2 is a MoE LLM provided and open-sourced by InclusionAI.☆277Oct 4, 2025Updated 10 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- FA4-based Relative Attention Kernel developed by TML and Colfax☆18Jul 17, 2026Updated last month
- Ring-V2 is a reasoning MoE LLM provided and open-sourced by InclusionAI.☆99Oct 23, 2025Updated 9 months ago
- ☆195Updated this week
- Make FP4 on 5090 Great Again☆22Jul 20, 2026Updated 3 weeks ago
- Accelerating MoE with IO and Tile-aware Optimizations☆745Updated this week
- Best practices for training DeepSeek, Mixtral, Qwen and other MoE models using Megatron Core.☆201May 29, 2026Updated 2 months ago
- The Newton-Muon optimizer☆29Jun 5, 2026Updated 2 months ago
- ☆27Feb 28, 2026Updated 5 months ago
- Communication patterns for AI, built on top of NCCL device and host APIs☆28Updated this week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Muon fsdp 2☆65Aug 8, 2025Updated last year
- ☆91Feb 5, 2026Updated 6 months ago
- A NCCL extension library, designed to efficiently offload GPU memory allocated by the NCCL communication library.☆116Dec 17, 2025Updated 8 months ago
- All-in-one benchmarking platform for evaluating LLM.☆15Nov 12, 2025Updated 9 months ago
- A Multi-Policy, Multi-Agent RL Training Framework☆32Jun 16, 2026Updated 2 months ago
- Production-ready MoE load balancing via real-time expert replication☆241Jul 17, 2026Updated last month
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆46Jul 17, 2024Updated 2 years ago
- ☆25Feb 27, 2026Updated 5 months ago
- A single-line modification to any (dualizer-based) optimizer that allows the optimizer to adapt to the scale of the gradients as they cha…☆19Jan 11, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆198Feb 11, 2026Updated 6 months ago
- ☆52Mar 9, 2026Updated 5 months ago
- Accelerate inference without tears☆370Jan 23, 2026Updated 6 months ago
- FlashKDA: high-performance Kimi Delta Attention kernels☆1,214Jul 30, 2026Updated 2 weeks ago
- Fast and memory-efficient exact attention☆23Jun 26, 2026Updated last month
- Skills for writing tilelang and debugging with CUDA toolkits.☆133May 20, 2026Updated 2 months ago
- ☆266Updated this week
- Expert Specialization MoE Solution based on CUTLASS☆27Apr 14, 2026Updated 4 months ago
- ☆46Feb 28, 2026Updated 5 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Muon in Int8 Precision Made Possible☆20Jun 18, 2026Updated 2 months ago
- An Optimizer for Nvidia Compilers.☆128Updated this week
- Perplexity GPU Kernels☆601Nov 7, 2025Updated 9 months ago
- PyTorch bindings for CUTLASS grouped GEMM.☆154May 29, 2025Updated last year
- NCU-driven iterative optimization workflow for CUDA/CUTLASS/Triton/CuTe DSL kernels.☆24Apr 10, 2026Updated 4 months ago
- Fast Hadamard transform in CUDA, with a PyTorch interface☆345Mar 10, 2026Updated 5 months ago
- Codes for DATA: Differentiable ArchiTecture Approximation.☆11Jul 22, 2021Updated 5 years ago