Alternatives and similar repositories for running-nvidia-sxm-gpus-in-consumer-pcs:

Users that are interested in running-nvidia-sxm-gpus-in-consumer-pcs are comparing it to the libraries listed below

• l4rz / building-a-poor-mans-supercomputer
  I've built a 4x V100 box for less than $5,500.
  ☆128Updated 3 years ago
• rahulunair / stable_diffusion_arc
  Stable Difussion inference on Intel Arc dGPUs
  ☆72Updated 10 months ago
• olealgoritme / gddr6
  Linux​ based GDDR6/GDDR6X VRAM temperature reader for NVIDIA RTX 3000/4000 series GPUs.
  ☆89Updated 5 months ago
• anthonix / llm.c
  LLM training in simple, raw C/HIP for AMD GPUs
  ☆37Updated 4 months ago
• Repeerc / flash-attention-v2-RDNA3-minimal
  a simple Flash Attention v2 implementation with ROCM (RDNA3 GPU, roc wmma), mainly used for stable diffusion(ComfyUI) in Windows ZLUDA en…
  ☆35Updated 5 months ago
• ROCm / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆42Updated 2 weeks ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆88Updated this week
• amd / fuzzyHSA
  ☆54Updated 7 months ago
• marty1885 / llama.cpp
  My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend
  ☆80Updated last week
• JingShing / How-to-use-tesla-p40
  A manual for helping using tesla p40 gpu
  ☆114Updated 2 months ago
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆152Updated this week
• arlo-phoenix / bitsandbytes-rocm-5.6
  8-bit CUDA functions for PyTorch Rocm compatible
  ☆39Updated 10 months ago
• LambdaLabsML / llama
  Inference code for LLaMA models
  ☆41Updated last year
• aidatatools / ollama-benchmark
  LLM Benchmark for Throughput via Ollama (Local LLMs)
  ☆162Updated last week
• rejunity / tiny-asic-1_58bit-matrix-mul
  Tiny ASIC implementation for "The Era of 1-bit LLMs All Large Language Models are in 1.58 Bits" matrix multiplication unit
  ☆115Updated 9 months ago
• sasha0552 / nvidia-pstated
  A daemon that automatically manages the performance states of NVIDIA GPUs.
  ☆51Updated 3 months ago
• pomoke / torch-apu-helper
  Make PyTorch models at least run on APUs.
  ☆46Updated last year
• silphendio / sliced_llama
  Simple LLM inference server
  ☆20Updated 7 months ago
• abacusai / gh200-llm
  Docker image NVIDIA GH200 machines - optimized for vllm serving and hf trainer finetuning
  ☆26Updated this week
• ROCm / xformers
  Hackable and optimized Transformers building blocks, supporting a composable construction.
  ☆22Updated last week
• xaedes / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆20Updated last year
• bjj / exllamav2-openai-server
  An OpenAI API compatible LLM inference server based on ExLlamaV2.
  ☆24Updated 11 months ago
• crashr / gppm
  GPU Power and Performance Manager
  ☆52Updated 3 months ago
• Cornell-RelaxML / qtip
  ☆100Updated last month
• Juice-Labs / Juice-Labs
  Juice Community Version Public Release
  ☆548Updated last year
• RedTopper / Text-Generation-Webui-Podman
  Generate Large Language Model text in a container.
  ☆20Updated last year
• blackhole89 / autopen
  Editor with LLM generation tree exploration
  ☆10Updated this week
• lachlansneff / sparsellama
  ☆40Updated last year
• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆69Updated 3 months ago