☆168Dec 27, 2024Updated last year
Alternatives and similar repositories for symm-mem-recipes
Users that are interested in symm-mem-recipes are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- extensible collectives library in triton☆98Mar 31, 2025Updated last year
- Distributed Compiler based on Triton for Parallel Systems☆1,455Apr 22, 2026Updated last month
- A fast communication-overlapping library for tensor/expert parallelism on GPUs.☆1,319Aug 28, 2025Updated 9 months ago
- A lightweight design for computation-communication overlap.☆234Jan 20, 2026Updated 4 months ago
- Perplexity GPU Kernels☆587Nov 7, 2025Updated 7 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Distributed MoE in a Single Kernel [NeurIPS '25]☆264May 5, 2026Updated last month
- ☆106Sep 9, 2024Updated last year
- ☆121May 16, 2025Updated last year
- Inference Llama 2 with a model compiled to native code by TorchInductor☆14Feb 8, 2024Updated 2 years ago
- study of cutlass☆22Nov 10, 2024Updated last year
- 使用 cutlass 仓库在 ada 架构上实现 fp8 的 flash attention☆81Aug 12, 2024Updated last year
- A Top-Down Profiler for GPU Applications☆22Feb 29, 2024Updated 2 years ago
- Triton-based Symmetric Memory operators and examples☆100May 15, 2026Updated 3 weeks ago
- Allow torch tensor memory to be released and resumed later☆247May 16, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Ongoing research training transformer models at scale☆18Updated this week
- Custom kernels in Triton language for accelerating LLMs☆26Apr 5, 2024Updated 2 years ago
- My tests and experiments with some popular dl frameworks.☆17Sep 11, 2025Updated 8 months ago
- FlagGems is an operator library for large language models implemented in the Triton Language.☆1,013Updated this week
- A NCCL extension library, designed to efficiently offload GPU memory allocated by the NCCL communication library.☆109Dec 17, 2025Updated 5 months ago
- Dynamic Memory Management for Serving LLMs without PagedAttention☆487May 30, 2025Updated last year
- Examples of CUDA implementations by Cutlass CuTe☆278Jul 1, 2025Updated 11 months ago
- Thunder Research Group's Collective Communication Library☆53Jul 8, 2025Updated 11 months ago
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆358Jun 2, 2026Updated last week
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆110Jun 28, 2025Updated 11 months ago
- ☆85Dec 2, 2022Updated 3 years ago
- A collection of memory efficient attention operators implemented in the Triton language.☆295Jun 1, 2026Updated last week
- FlashInfer: Kernel Library for LLM Serving☆5,760Updated this week
- Helpful kernel tutorials, examples and SKILLs for tile-based GPU programming☆745Updated this week
- TORCH_TRACE parser for PT2☆86May 11, 2026Updated 3 weeks ago
- Examples demonstrating available options to program multiple GPUs in a single node or a cluster☆892Sep 26, 2025Updated 8 months ago
- Utility scripts for PyTorch (e.g. Make Perfetto show some disappearing kernels, Memory profiler that understands more low-level allocatio…☆108Sep 11, 2025Updated 8 months ago
- ☆22May 5, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Cataloging released Triton kernels.☆307Sep 9, 2025Updated 9 months ago
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆155May 10, 2025Updated last year
- NVIDIA Inference Xfer Library (NIXL)☆1,072Updated this week
- Tile primitives for speedy kernels☆3,405May 27, 2026Updated last week
- ☆267Jul 11, 2024Updated last year
- [DEPRECATED] Moved to ROCm/rocm-systems repo☆146May 28, 2026Updated last week
- We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel …☆193Jan 28, 2025Updated last year