Alternatives and similar repositories for Stan-s-ML-Stack

Users that are interested in Stan-s-ML-Stack are comparing it to the libraries listed below

• jjziets / gddr6_temps
  Prometheus exporter for Linux​ based GDDR6/GDDR6X VRAM and GPU Core Hot spot temperature reader for NVIDIA RTX 3000/4000 series GPUs.
  ☆22Updated 10 months ago
• kooshi / llama-swappo
  llama-swap + a minimal ollama compatible api
  ☆23Updated this week
• sasha0552 / nvidia-pstated
  A daemon that automatically manages the performance states of NVIDIA GPUs.
  ☆93Updated 2 months ago
• lamikr / rocm_sdk_builder
  ☆381Updated 4 months ago
• kyuz0 / amd-strix-halo-toolboxes
  ☆129Updated this week
• nktice / AMD-AI
  AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
  ☆209Updated 6 months ago
• rjmalagon / ollama-linux-amd-apu
  AMD APU compatible Ollama. Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1 and other large language mod…
  ☆80Updated last week
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆198Updated this week
• mostlygeek / llama-swap
  Model swapping for llama.cpp (or any local OpenAPI compatible server)
  ☆1,370Updated this week
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆162Updated last year
• sanctuary-systems-com / llama_multiserver
  A proxy that hosts multiple single-model runners such as LLama.cpp and vLLM
  ☆11Updated 2 months ago
• Raskoll2 / LLMcalc
  A tool to determine whether or not your PC can run a given LLM
  ☆164Updated 6 months ago
• crashr / gppm
  GPU Power and Performance Manager
  ☆61Updated 10 months ago
• robertrosenbusch / gfx803_rocm
  General Site for the GFX803 ROCm Stuff
  ☆103Updated 3 weeks ago
• amanvirparhar / elara
  A simple tool to anonymize LLM prompts.
  ☆64Updated 7 months ago
• remghoost / notebookLM-different-podcast
  ☆58Updated 10 months ago
• sbnb-io / sbnb
  Linux distro for AI computers. Go from bare-metal GPUs to running AI workloads - like vLLM, SGLang, RAG, and Agents - in minutes, fully a…
  ☆240Updated last week
• QuantiusBenignus / BlahST
  Input text from speech in any Linux window, the lean, fast and accurate way, using whisper.cpp OFFLINE. Speak with local LLMs via llama.c…
  ☆126Updated last month
• kalavai-net / kalavai-client
  A platform to self-host AI on easy mode
  ☆159Updated 2 weeks ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆73Updated last week
• lemonade-sdk / llamacpp-rocm
  Fresh builds of llama.cpp with AMD ROCm™ 7 acceleration
  ☆31Updated this week
• anishgowda21 / tiny-ollama-chat
  A lightweight UI for chatting with Ollama models. Streaming responses, conversation history, and multi-model support.
  ☆114Updated 5 months ago
• m18coppola / llama.sh
  No-messing-around sh client for llama.cpp's server
  ☆30Updated last year
• FastFlowLM / FastFlowLM
  Run LLMs on AMD Ryzen™ AI NPUs. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.
  ☆129Updated last week
• cloudmercato / ollama-benchmark
  Handy tool to measure the performance and efficiency of LLMs workloads.
  ☆71Updated 4 months ago
• pomoke / torch-apu-helper
  Make PyTorch models at least run on APUs.
  ☆56Updated last year
• inferx-net / inferx
  InferX is a Inference Function as a Service Platform
  ☆128Updated this week
• atineiatte / deep-research-at-home
  ☆221Updated 3 months ago
• curvedinf / dir-assistant
  Chat with your current directory's files using a local or API LLM.
  ☆395Updated 2 months ago
• aidatatools / ollama-benchmark
  LLM Benchmark for Throughput via Ollama (Local LLMs)
  ☆280Updated 2 weeks ago