Alternatives and similar repositories for nvidia-resiliency-ext

Users that are interested in nvidia-resiliency-ext are comparing it to the libraries listed below

• facebookresearch / HolisticTraceAnalysis
  A library to analyze PyTorch traces.
  ☆464Updated last week
• perplexityai / pplx-kernels
  Perplexity GPU Kernels
  ☆554Updated 2 months ago
• yifuwang / symm-mem-recipes
  ☆158Updated last year
• google / nccl-fastsocket
  NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.
  ☆122Updated 2 years ago
• ai-dynamo / nixl
  NVIDIA Inference Xfer Library (NIXL)
  ☆844Updated last week
• meta-pytorch / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆314Updated 5 months ago
• meta-pytorch / torchcomms
  torchcomms: a modern PyTorch communications API
  ☆323Updated this week
• sail-sg / zero-bubble-pipeline-parallelism
  Zero Bubble Pipeline Parallelism
  ☆449Updated 8 months ago
• microsoft / mscclpp
  MSCCL++: A GPU-driven communication stack for scalable AI applications
  ☆455Updated this week
• NVIDIA / nvshmem
  NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM can significantly reduce multi-process com…
  ☆459Updated last month
• mk1-project / quickreduce
  QuickReduce is a performant all-reduce library designed for AMD ROCm that supports inline compression.
  ☆36Updated 5 months ago
• ai-dynamo / aiconfigurator
  Offline optimization of your disaggregated Dynamo graph
  ☆168Updated this week
• facebookresearch / param
  PArametrized Recommendation and Ai Model benchmark is a repository for development of numerous uBenchmarks as well as end to end nets for…
  ☆155Updated last week
• perplexityai / pplx-garden
  Perplexity open source garden for inference technology
  ☆350Updated last month
• aws / aws-ofi-nccl
  This is a plugin which lets EC2 developers use libfabric as network provider while running NCCL applications.
  ☆203Updated last week
• sgl-project / genai-bench
  Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…
  ☆260Updated this week
• coreweave / nccl-tests
  NVIDIA NCCL Tests for Distributed Training
  ☆133Updated this week
• Deep-Learning-Profiling-Tools / triton-viz
  ☆277Updated this week
• microsoft / sarathi-serve
  A low-latency & high-throughput serving engine for LLMs
  ☆470Updated 3 weeks ago
• NVIDIA / cuda-checkpoint
  CUDA checkpoint and restore utility
  ☆406Updated 4 months ago
• Mellanox / nccl-rdma-sharp-plugins
  RDMA and SHARP plugins for nccl library
  ☆221Updated 2 weeks ago
• imbue-ai / cluster-health
  ☆321Updated last year
• microsoft / vattention
  Dynamic Memory Management for Serving LLMs without PagedAttention
  ☆457Updated 8 months ago
• ColfaxResearch / cutlass-kernels
  ☆258Updated last year
• fzyzcjy / torch_memory_saver
  Allow torch tensor memory to be released and resumed later
  ☆213Updated 2 weeks ago
• meta-pytorch / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆319Updated this week
• microsoft / NPKit
  NCCL Profiling Kit
  ☆150Updated last year
• NVIDIA / nvbandwidth
  A tool for bandwidth measurements on NVIDIA GPUs.
  ☆610Updated 9 months ago
• microsoft / msccl
  Microsoft Collective Communication Library
  ☆379Updated 2 years ago
• Dao-AILab / quack
  A Quirky Assortment of CuTe Kernels
  ☆772Updated this week