Alternatives and similar repositories for llama.cpp-gfx906

Users that are interested in llama.cpp-gfx906 are comparing it to the libraries listed below

• conanhujinming / text_dedup
  High-Performance Text Deduplication Toolkit
  ☆56Updated last month
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆211Updated this week
• crashr / gppm
  GPU Power and Performance Manager
  ☆61Updated 11 months ago
• Thireus / GGUF-Tool-Suite
  Input your VRAM and RAM and the toolchain will produce a GGUF model tuned to your system within seconds — flexible model sizing and lowes…
  ☆45Updated this week
• ROCm / TheRock
  The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm
  ☆398Updated this week
• spectral-compute / scale-examples
  ☆62Updated last year
• lamikr / rocm_sdk_builder
  ☆395Updated 5 months ago
• amd / MxGPU-Virtualization
  ☆143Updated 2 weeks ago
• sasha0552 / nvidia-pstated
  A daemon that automatically manages the performance states of NVIDIA GPUs.
  ☆96Updated 3 weeks ago
• Said-Akbar / vllm-rocm
  FORK of VLLM for AMD MI25/50/60. A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆64Updated 4 months ago
• inferx-net / inferx
  InferX: Inference as a Service Platform
  ☆135Updated this week
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆1,198Updated this week
• lhl / strix-halo-testing
  ☆76Updated 2 weeks ago
• amd / ryzen-ai-documentation
  Onboarding documentation source for the AMD Ryzen™ AI Software Platform. The AMD Ryzen™ AI Software Platform enables developers to take…
  ☆78Updated this week
• aikitoria / open-gpu-kernel-modules
  NVIDIA Linux open GPU with P2P support
  ☆54Updated this week
• amd / xdna-driver
  ☆468Updated this week
• amd / fuzzyHSA
  ☆53Updated last year
• kioxia-jp / aisaq-diskann
  All-in-Storage Solution based on DiskANN for DRAM-free Approximate Nearest Neighbor Search
  ☆73Updated 2 months ago
• jameswdelancey / llama3.c
  A faithful clone of Karpathy's llama2.c (one file inference, zero dependency) but fully functional with LLaMA 3 8B base and instruct mode…
  ☆138Updated last year
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆82Updated last week
• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆279Updated this week
• sasha0552 / nvidia-pstate
  A library and CLI utilities for managing performance states of NVIDIA GPUs.
  ☆28Updated 11 months ago
• AmpereComputingAI / llama.cpp
  Ampere optimized llama.cpp
  ☆24Updated last week
• FastFlowLM / FastFlowLM
  Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.
  ☆207Updated this week
• nlzy / vllm-gfx906
  vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60
  ☆257Updated this week
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆163Updated last year
• extopico / llama-server_mcp_proxy
  Simple node proxy for llama-server that enables MCP use
  ☆13Updated 4 months ago
• l4rz / running-nvidia-sxm-gpus-in-consumer-pcs
  Running SXM2/SXM3/SXM4 NVidia data center GPUs in consumer PCs
  ☆125Updated 2 years ago
• Orolol / familyBench
  FamilyBench evaluation tool for testing the relational reasoning capabilities of Large Language Models (LLMs).
  ☆36Updated last month
• theroyallab / YALS
  ☆85Updated last week