Alternatives and similar repositories for running-nvidia-sxm-gpus-in-consumer-pcs

Users that are interested in running-nvidia-sxm-gpus-in-consumer-pcs are comparing it to the libraries listed below

• ROCm / TheRock
  The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm
  ☆234Updated this week
• BlinkDL / fast.c
  Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
  ☆72Updated 5 months ago
• olealgoritme / gddr6
  Linux​ based GDDR6/GDDR6X VRAM temperature reader for NVIDIA RTX 3000/4000 series GPUs.
  ☆101Updated 2 months ago
• amd / fuzzyHSA
  ☆54Updated last year
• anthonix / llm.c
  LLM training in simple, raw C/HIP for AMD GPUs
  ☆50Updated 9 months ago
• JingShing / How-to-use-tesla-p40
  A manual for helping using tesla p40 gpu
  ☆126Updated 8 months ago
• ReinForce-II / mmapeak
  ☆31Updated 3 months ago
• aikitoria / open-gpu-kernel-modules
  NVIDIA Linux open GPU with P2P support
  ☆25Updated last month
• pomoke / torch-apu-helper
  Make PyTorch models at least run on APUs.
  ☆54Updated last year
• Said-Akbar / vllm-rocm
  FORK of VLLM for AMD MI25/50/60. A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆52Updated 2 months ago
• lamikr / rocm_sdk_builder
  ☆356Updated 3 months ago
• nktice / AMD-AI
  AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
  ☆209Updated 4 months ago
• tinygrad / tinyos
  ☆35Updated last week
• tinygrad / 7900xtx
  ☆448Updated 3 months ago
• tinygrad / open-gpu-kernel-modules
  NVIDIA Linux open GPU with P2P support
  ☆1,188Updated last month
• sasha0552 / nvidia-pstated
  A daemon that automatically manages the performance states of NVIDIA GPUs.
  ☆89Updated last month
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆188Updated this week
• huggingface / optimum-amd
  AMD related optimizations for transformer models
  ☆80Updated 3 weeks ago
• kioxia-jp / aisaq-diskann
  All-in-Storage Solution based on DiskANN for DRAM-free Approximate Nearest Neighbor Search
  ☆66Updated 2 weeks ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆87Updated this week
• onnx / turnkeyml
  No-code CLI designed for accelerating ONNX workflows
  ☆201Updated last month
• l4rz / building-a-poor-mans-supercomputer
  I've built a 4x V100 box for less than $5,500.
  ☆141Updated 3 years ago
• amd / xdna-driver
  ☆430Updated this week
• ScalingIntelligence / good-kernels
  Samples of good AI generated CUDA kernels
  ☆84Updated last month
• Juice-Labs / Juice-Labs
  Juice Community Version Public Release
  ☆594Updated 2 months ago
• joennlae / halutmatmul
  Hashed Lookup Table based Matrix Multiplication (halutmatmul) - Stella Nera accelerator
  ☆211Updated last year
• xuhuisheng / rocm-build
  build scripts for ROCm
  ☆186Updated last year
• Figura-Labs-Inc / telegraf_nv_export
  Ultra low overhead NVIDIA GPU telemetry plugin for telegraf with memory temperature readings.
  ☆62Updated last year
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆177Updated this week
• marty1885 / llama.cpp
  My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend
  ☆97Updated 2 weeks ago