Alternatives and similar repositories for Primus

Users that are interested in Primus are comparing it to the libraries listed below

• perplexityai / pplx-garden
  Perplexity open source garden for inference technology
  ☆350Updated last month
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆63Updated 7 months ago
• AI-Hypercomputer / jetstream-pytorch
  PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
  ☆80Updated last month
• NVIDIA / nvidia-resiliency-ext
  NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …
  ☆253Updated last week
• facebookresearch / param
  PArametrized Recommendation and Ai Model benchmark is a repository for development of numerous uBenchmarks as well as end to end nets for…
  ☆155Updated last week
• intel / torch-ccl
  oneCCL Bindings for Pytorch* (deprecated)
  ☆104Updated last month
• cchan / tccl
  extensible collectives library in triton
  ☆93Updated 10 months ago
• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆344Updated last week
• NVIDIA / nvshmem
  NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM can significantly reduce multi-process com…
  ☆459Updated last month
• perplexityai / pplx-kernels
  Perplexity GPU Kernels
  ☆554Updated 2 months ago
• meta-pytorch / torchcomms
  torchcomms: a modern PyTorch communications API
  ☆323Updated this week
• meta-pytorch / torchft
  Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)
  ☆474Updated 2 weeks ago
• foundation-model-stack / foundation-model-stack
  🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
  ☆219Updated this week
• AI-Hypercomputer / JetStream
  JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…
  ☆403Updated 3 weeks ago
• meta-pytorch / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆314Updated 5 months ago
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆113Updated 2 years ago
• gpu-mode / kernelbot
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆68Updated last week
• ROCm / iris
  AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming
  ☆164Updated last week
• dropbox / gemlite
  Fast low-bit matmul kernels in Triton
  ☆424Updated this week
• ROCm / rccl
  [DEPRECATED] Moved to ROCm/rocm-systems repo
  ☆410Updated this week
• NVIDIA / Fuser
  A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")
  ☆375Updated this week
• Deep-Learning-Profiling-Tools / triton-viz
  ☆277Updated this week
• facebookexperimental / triton
  Github mirror of trition-lang/triton repo.
  ☆126Updated last week
• vllm-project / tpu-inference
  TPU inference for vLLM, with unified JAX and PyTorch support.
  ☆223Updated this week
• aws / aws-ofi-nccl
  This is a plugin which lets EC2 developers use libfabric as network provider while running NCCL applications.
  ☆203Updated last week
• meta-pytorch / BackendBench
  Ship correct and fast LLM kernels to PyTorch
  ☆139Updated 2 weeks ago
• NVIDIA / compute-eval
  Evaluating Large Language Models for CUDA Code Generation ComputeEval is a framework designed to generate and evaluate CUDA code from Lar…
  ☆94Updated 3 weeks ago
• ROCm / aotriton
  Ahead of Time (AOT) Triton Math Library
  ☆88Updated this week
• deepspeedai / DeepSpeed-Kernels
  ☆71Updated 10 months ago
• ROCm / rccl-tests
  [DEPRECATED] Moved to ROCm/rocm-systems repo
  ☆86Updated last week