Alternatives and similar repositories for MultiAMDGPU_AIDev_Ubuntu

Users that are interested in MultiAMDGPU_AIDev_Ubuntu are comparing it to the libraries listed below

• SearchSavior / OpenArc
  Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.
  ☆260Updated last week
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆217Updated last year
• nktice / AMD-AI
  AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
  ☆216Updated 2 weeks ago
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆597Updated this week
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆189Updated last year
• yoziru / nextjs-vllm-ui
  Fully-featured, beautiful web interface for vLLM - built with NextJS.
  ☆163Updated last week
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆610Updated 9 months ago
• kalavai-net / kalavai-client
  A platform to self-host AI on easy mode
  ☆179Updated this week
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆266Updated 9 months ago
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆514Updated 10 months ago
• gpustack / gguf-parser-go
  Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
  ☆219Updated 3 months ago
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆165Updated last year
• v2rockets / Loyal-Elephie
  Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible
  ☆344Updated 9 months ago
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆148Updated 5 months ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆99Updated last year
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆103Updated last week
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆1,387Updated this week
• matteoserva / GraphLLM
  ☆209Updated 3 months ago
• runpod-workers / worker-vllm
  The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
  ☆386Updated last week
• foldl / chatllm.cpp
  Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
  ☆753Updated this week
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆85Updated this week
• sasha0552 / pascal-pkgs-ci
  The main repository for building Pascal-compatible versions of ML applications and libraries.
  ☆155Updated 3 months ago
• crashr / gppm
  GPU Power and Performance Manager
  ☆62Updated last year
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆293Updated 3 weeks ago
• aidatatools / ollama-benchmark
  LLM Benchmark for Throughput via Ollama (Local LLMs)
  ☆314Updated this week
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆119Updated last year
• teabranch / open-responses-server
  Wraps any OpenAI API interface as Responses with MCPs support so it supports Codex. Adding any missing stateful features. Ollama and Vllm…
  ☆138Updated last month
• iluxu / llmbasedos
  llmbasedos — Local-First OS Where Your AI Agents Wake Up and Work
  ☆278Updated 3 months ago
• avarayr / suaveui
  Open source LLM UI, compatible with all local LLM providers.
  ☆176Updated last year
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆99Updated 5 months ago