A high-performance kernel library for LLM training
☆86Apr 28, 2026Updated 3 months ago
Alternatives and similar repositories for linghe
Users that are interested in linghe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Feb 26, 2026Updated 5 months ago
- Ring is a reasoning MoE LLM provided and open-sourced by InclusionAI, derived from Ling.☆109Aug 5, 2025Updated 11 months ago
- CUDA kernels for linear attention variants, written in CuTe DSL and CUTLASS C++.☆535Jul 23, 2026Updated last week
- Ling is a MoE LLM provided and open-sourced by InclusionAI.☆262May 14, 2025Updated last year
- Ling-V2 is a MoE LLM provided and open-sourced by InclusionAI.☆273Oct 4, 2025Updated 9 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- FA4-based Relative Attention Kernel developed by TML and Colfax☆17Jul 17, 2026Updated last week
- Ring-V2 is a reasoning MoE LLM provided and open-sourced by InclusionAI.☆98Oct 23, 2025Updated 9 months ago
- ☆171Updated this week
- Make FP4 on 5090 Great Again☆17Jul 20, 2026Updated last week
- Accelerating MoE with IO and Tile-aware Optimizations☆733Jul 4, 2026Updated 3 weeks ago
- Best practices for training DeepSeek, Mixtral, Qwen and other MoE models using Megatron Core.☆201May 29, 2026Updated 2 months ago
- The Newton-Muon optimizer☆30Jun 5, 2026Updated last month
- ☆28Feb 28, 2026Updated 5 months ago
- Communication patterns for AI, built on top of NCCL device and host APIs☆21Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Muon fsdp 2☆64Aug 8, 2025Updated 11 months ago
- ☆84Feb 5, 2026Updated 5 months ago
- A NCCL extension library, designed to efficiently offload GPU memory allocated by the NCCL communication library.☆113Dec 17, 2025Updated 7 months ago
- All-in-one benchmarking platform for evaluating LLM.☆15Nov 12, 2025Updated 8 months ago
- A Multi-Policy, Multi-Agent RL Training Framework☆32Jun 16, 2026Updated last month
- Production-ready expert load balancing library☆80Jul 17, 2026Updated last week
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆46Jul 17, 2024Updated 2 years ago
- ☆26Feb 27, 2026Updated 5 months ago
- A single-line modification to any (dualizer-based) optimizer that allows the optimizer to adapt to the scale of the gradients as they cha…☆19Jan 11, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆195Feb 11, 2026Updated 5 months ago
- ☆52Mar 9, 2026Updated 4 months ago
- Accelerate inference without tears☆371Jan 23, 2026Updated 6 months ago
- FlashKDA: high-performance Kimi Delta Attention kernels☆982Updated this week
- Fast and memory-efficient exact attention☆22Jun 26, 2026Updated last month
- Skills for writing tilelang and debugging with CUDA toolkits.☆133May 20, 2026Updated 2 months ago
- ☆240Updated this week
- Expert Specialization MoE Solution based on CUTLASS☆27Apr 14, 2026Updated 3 months ago
- ☆45Feb 28, 2026Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Muon in Int8 Precision Made Possible☆20Jun 18, 2026Updated last month
- An Optimizer for Nvidia Compilers.☆112Jul 3, 2026Updated 3 weeks ago
- Perplexity GPU Kernels☆595Nov 7, 2025Updated 8 months ago
- PyTorch bindings for CUTLASS grouped GEMM.☆154May 29, 2025Updated last year
- NCU-driven iterative optimization workflow for CUDA/CUTLASS/Triton/CuTe DSL kernels.☆24Apr 10, 2026Updated 3 months ago
- Fast Hadamard transform in CUDA, with a PyTorch interface☆343Mar 10, 2026Updated 4 months ago
- Codes for DATA: Differentiable ArchiTecture Approximation.☆11Jul 22, 2021Updated 5 years ago