Alternatives and similar repositories for Stan-s-ML-Stack

Users that are interested in Stan-s-ML-Stack are comparing it to the libraries listed below

• SearchSavior / OpenArc
  Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.
  ☆283Updated last week
• sasha0552 / nvidia-pstated
  A daemon that automatically manages the performance states of NVIDIA GPUs.
  ☆110Updated 2 months ago
• nktice / AMD-AI
  AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
  ☆217Updated 2 months ago
• robertrosenbusch / gfx803_rocm
  General Site for the GFX803 ROCm Stuff
  ☆145Updated 5 months ago
• FastFlowLM / FastFlowLM
  Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.
  ☆665Updated last week
• kooshi / llama-swappo
  llama-swap + a minimal ollama compatible api
  ☆45Updated last week
• lamikr / rocm_sdk_builder
  ☆426Updated 9 months ago
• inferx-net / inferx
  InferX: Inference as a Service Platform
  ☆151Updated this week
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆622Updated this week
• sasha0552 / nvidia-pstate
  A library and CLI utilities for managing performance states of NVIDIA GPUs.
  ☆33Updated last year
• jjziets / gddr6_temps
  Prometheus exporter for Linux​ based GDDR6/GDDR6X VRAM and GPU Core Hot spot temperature reader for NVIDIA RTX 3000/4000 series GPUs.
  ☆24Updated last year
• iacopPBK / llama.cpp-gfx906
  llama.cpp-gfx906
  ☆85Updated 2 weeks ago
• synexo / subtitler
  A utility that uses Whisper to transcribe videos and various translation APIs to translate the transcribed text and save them as SRT (sub…
  ☆74Updated last year
• Raskoll2 / LLMcalc
  A tool to determine whether or not your PC can run a given LLM
  ☆167Updated last year
• atineiatte / deep-research-at-home
  ☆229Updated 8 months ago
• remghoost / notebookLM-different-podcast
  ☆57Updated last year
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆1,553Updated this week
• crashr / gppm
  GPU Power and Performance Manager
  ☆66Updated last year
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆165Updated last year
• intelligencedev / manifold
  Manifold is an experimental platform for enabling long horizon workflow automation using teams of AI assistants.
  ☆477Updated this week
• kalavai-net / kalavai-client
  Aggregates compute from spare GPU capacity
  ☆189Updated this week
• theroyallab / YALS
  ☆89Updated last month
• ThomasBaruzier / gddr6-core-junction-vram-temps
  Core, Junction, and VRAM temperature reader for Linux + GDDR6/GDDR6X GPUs
  ☆65Updated 3 months ago
• v2rockets / Loyal-Elephie
  Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible
  ☆345Updated 11 months ago
• mehtabmahir / easy-whisper-ui
  Easy to use interface for the Whisper model optimized for all GPUs!
  ☆450Updated 2 weeks ago
• avarayr / suaveui
  Open source LLM UI, compatible with all local LLM providers.
  ☆177Updated last year
• mostlygeek / llama-swap
  Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc
  ☆2,260Updated last week
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆513Updated 11 months ago
• antibitcoin / ReflectionAnyLLM
  This project demonstrates a basic chain-of-thought interaction with any LLM (Large Language Model)
  ☆322Updated last year
• lemonade-sdk / llamacpp-rocm
  Fresh builds of llama.cpp with AMD ROCm™ 7 acceleration
  ☆167Updated last week