Alternatives and similar repositories for MultiAMDGPU_AIDev_Ubuntu

Users that are interested in MultiAMDGPU_AIDev_Ubuntu are comparing it to the libraries listed below

• SearchSavior / OpenArc
  Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.
  ☆283Updated last week
• nktice / AMD-AI
  AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
  ☆217Updated 2 months ago
• aidatatools / ollama-benchmark
  LLM Benchmark for Throughput via Ollama (Local LLMs)
  ☆326Updated last week
• yoziru / nextjs-vllm-ui
  Fully-featured, beautiful web interface for vLLM - built with NextJS.
  ☆171Updated last month
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆267Updated 10 months ago
• EtiennePerot / safe-code-execution
  Code execution utilities for Open WebUI & Ollama
  ☆317Updated last year
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆165Updated last year
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆216Updated last year
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆612Updated 11 months ago
• matteoserva / GraphLLM
  ☆209Updated 3 weeks ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆88Updated this week
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆622Updated last week
• sasha0552 / vllm-ci
  CI scripts designed to build a Pascal-compatible version of vLLM.
  ☆12Updated last year
• kalavai-net / kalavai-client
  Aggregates compute from spare GPU capacity
  ☆189Updated this week
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆100Updated last year
• chigkim / Ollama-MMLU-Pro
  ☆109Updated 5 months ago
• theroyallab / tabbyAPI
  The official API server for Exllama. OAI compatible, lightweight, and fast.
  ☆1,119Updated last week
• SomeOddCodeGuy / WilmerAI
  WilmerAI is one of the oldest LLM semantic routers. It uses multi-layer prompt routing and complex workflows to allow you to not only cre…
  ☆799Updated 3 weeks ago
• cduk / vllm-pascal
  A fork of vLLM enabling Pascal architecture GPUs
  ☆31Updated 11 months ago
• aikitoria / open-gpu-kernel-modules
  NVIDIA Linux open GPU with P2P support
  ☆119Updated last month
• gpustack / gguf-parser-go
  Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
  ☆236Updated 3 weeks ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆219Updated last month
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆188Updated last year
• v2rockets / Loyal-Elephie
  Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible
  ☆345Updated 11 months ago
• armbues / SiLLM
  SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.
  ☆284Updated 7 months ago
• noco-ai / spellbook-docker
  AI stack for interacting with LLMs, Stable Diffusion, Whisper, xTTS and many other AI models
  ☆168Updated last year
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆154Updated 6 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆243Updated last year
• iluxu / llmbasedos
  llmbasedos — Local-First OS Where Your AI Agents Wake Up and Work
  ☆281Updated 3 weeks ago
• sasha0552 / pascal-pkgs-ci
  The main repository for building Pascal-compatible versions of ML applications and libraries.
  ☆163Updated 5 months ago