Alternatives and similar repositories for Primus

Users that are interested in Primus are comparing it to the libraries listed below

• AI-Hypercomputer / jetstream-pytorch
  PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
  ☆79Updated last month
• AI-Hypercomputer / JetStream
  JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…
  ☆404Updated last month
• perplexityai / pplx-garden
  Perplexity open source garden for inference technology
  ☆359Updated last month
• NVIDIA / nvidia-resiliency-ext
  NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …
  ☆262Updated this week
• foundation-model-stack / foundation-model-stack
  🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
  ☆219Updated last week
• NVIDIA / Fuser
  A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")
  ☆380Updated this week
• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆351Updated this week
• meta-pytorch / torchft
  Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)
  ☆475Updated this week
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆64Updated 7 months ago
• perplexityai / pplx-kernels
  Perplexity GPU Kernels
  ☆554Updated 3 months ago
• facebookresearch / param
  PArametrized Recommendation and Ai Model benchmark is a repository for development of numerous uBenchmarks as well as end to end nets for…
  ☆156Updated this week
• intel / torch-ccl
  oneCCL Bindings for Pytorch* (deprecated)
  ☆104Updated last month
• ROCm / rccl
  [DEPRECATED] Moved to ROCm/rocm-systems repo
  ☆410Updated this week
• cchan / tccl
  extensible collectives library in triton
  ☆95Updated 10 months ago
• meta-pytorch / torchcomms
  torchcomms: a modern PyTorch communications API
  ☆327Updated this week
• dropbox / gemlite
  Fast low-bit matmul kernels in Triton
  ☆427Updated last week
• vllm-project / tpu-inference
  TPU inference for vLLM, with unified JAX and PyTorch support.
  ☆228Updated this week
• meta-pytorch / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆315Updated 5 months ago
• gpu-mode / kernelbot
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆68Updated last week
• meta-pytorch / BackendBench
  Ship correct and fast LLM kernels to PyTorch
  ☆140Updated 3 weeks ago
• Deep-Learning-Profiling-Tools / triton-viz
  ☆286Updated this week
• snowflakedb / ArcticInference
  ArcticInference: vLLM plugin for high-throughput, low-latency inference
  ☆384Updated last week
• ROCm / rccl-tests
  [DEPRECATED] Moved to ROCm/rocm-systems repo
  ☆86Updated 2 weeks ago
• intel / torch-xpu-ops
  ☆74Updated this week
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆113Updated 2 years ago
• NVIDIA / compute-eval
  Evaluating Large Language Models for CUDA Code Generation ComputeEval is a framework designed to generate and evaluate CUDA code from Lar…
  ☆96Updated last month
• intel / intel-xpu-backend-for-triton
  OpenAI Triton backend for Intel® GPUs
  ☆226Updated last week
• InferenceMAX / InferenceMAX
  Open Source Continuous Inference Benchmarking - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 vs H100 & soon™ TPUv6e/v7/Trainium2/3- DeepS…
  ☆445Updated this week
• ScalingIntelligence / KernelBench
  KernelBench: Can LLMs Write GPU Kernels? - Benchmark + Toolkit with Torch -> CUDA (+ more DSLs)
  ☆792Updated 2 weeks ago
• deepspeedai / DeepSpeed-Kernels
  ☆71Updated 10 months ago