Speed-of-Light SW efficiency by using ultra low-latency primitives for comms collectives
☆13Apr 8, 2026Updated 6 months ago
Alternatives and similar repositories for yali
Users that are interested in yali are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- NCCL communication API layer, and transport layer created from first principles.☆16Aug 20, 2025Updated last year
- Repository for supplemental codes for GPU Programming☆18May 16, 2024Updated 2 years ago
- SWE-Serve: an agentic benchmark of 53 production inference-engineering tasks derived from merged SGLang pull requests, run with Harbor.☆21Oct 9, 2026Updated 2 weeks ago
- Aggressive decode optimizations for Qwen3-0.6B on RTX 5090☆64Feb 25, 2026Updated 8 months ago
- Interactive 3D model of NVIDIA Vera Rubin hardware (superchip, NVL72 compute tray, HGX NVL8) with connection tracing and a guided tour☆16Oct 1, 2026Updated 3 weeks ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A fast and space-efficient graph storage data structure.☆24May 27, 2026Updated 5 months ago
- GPU Functional Descriptor for memory access☆35May 24, 2026Updated 5 months ago
- Implemented and benchmarked KV cache compression methods for LLM inference in Triton. Optimized kernels for KIVI and TurboQuant with Flas…☆18Jun 19, 2026Updated 4 months ago
- observability for speculative decoding☆15Aug 23, 2026Updated 2 months ago
- Rust bindings for CTranslate2☆14Jun 21, 2023Updated 3 years ago
- High-performance tokenization for inference☆14Oct 21, 2026Updated last week
- llama2 inference engine in Rust☆13Apr 12, 2024Updated 2 years ago
- High-performance GPU kernels for LLM inference in OpenAI Triton. Fused RMSNorm, SwiGLU, INT8 GEMM with benchmarks and roofline analysis.☆44Jul 22, 2026Updated 3 months ago
- Bookmarklet which pick random file containing explicit content and replaces it with something nice in your behalf.☆10Jan 7, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- General purpose benchmarking tool for turbopuffer deployments☆52Updated this week
- Resources for RadixMLP☆14Jan 18, 2026Updated 9 months ago
- Application of Ford-Fulkerson algorithm to find the maximum matching between 2 sides of a bipartite graph☆12Apr 21, 2017Updated 9 years ago
- LLM Kernel Library for Rust☆32Updated this week
- ☆58Apr 22, 2026Updated 6 months ago
- ☆41Oct 5, 2026Updated 3 weeks ago
- ☆15Mar 11, 2026Updated 7 months ago
- An example OpenAI /chat/completions endpoint☆13Sep 26, 2026Updated last month
- Drop-in GPU kernel optimizer for PyTorch models, no CUDA or GPU expertise required☆25Jun 7, 2026Updated 4 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A demonstration of source code transformation to implement automatic differentiation, compatible with an operation overload style AD libr…☆14Jul 15, 2022Updated 4 years ago
- Learning notes for understanding modern Machine Learning System.☆65Updated this week
- CUDA GPU Benchmark☆39Jan 31, 2025Updated last year
- A notebook using numpy, scipy, and matplotlib to show the concepts taught in the course Linear Algebra by Prof. Gilbert Strang at MIT☆11Jul 16, 2022Updated 4 years ago
- Native Blackwell (sm_100) tcgen05 training backward for the gated-linear-recurrence family (GDN/KDA/GLA/SSD/LA), plus a contract-grade ve…☆15Oct 18, 2026Updated last week
- ☆13Jan 30, 2023Updated 3 years ago
- A kernel visualization that walks through each step of the code.☆14Aug 1, 2026Updated 2 months ago
- Plug-and-play PyTorch transformer research framework. Swap attention, FFN, norm, positional, connection, projection, optimizer, scheduler…☆18Updated this week
- Matrix multiplication on GPUs for matrices stored on a CPU. Similar to cublasXt, but ported to both NVIDIA and AMD GPUs.☆33Apr 2, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- GEMM☆10Aug 26, 2023Updated 3 years ago
- Automatic formal verification for warp-specialized GPU kernels.☆97Updated this week
- ☆15Jul 13, 2026Updated 3 months ago
- RedisTree - load & save Trees to Redis using sets☆13Feb 24, 2020Updated 6 years ago
- A Tiny (2kb) UI library based on hyperscript and virtual dom☆11Nov 6, 2018Updated 7 years ago
- ☆18Mar 18, 2024Updated 2 years ago
- A Chinese-focused PyTorch framework for exploring Attention Residuals in Qwen3-style causal LMs, with baseline, Block AttnRes, Full AttnR…☆21May 3, 2026Updated 5 months ago