Alternatives and similar repositories for MultiAMDGPU_AIDev_Ubuntu

Users that are interested in MultiAMDGPU_AIDev_Ubuntu are comparing it to the libraries listed below

• onnx / turnkeyml
  Local LLM Server with NPU Acceleration
  ☆180Updated last week
• crashr / gppm
  GPU Power and Performance Manager
  ☆58Updated 7 months ago
• BlinkDL / fast.c
  Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
  ☆72Updated 3 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆175Updated this week
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆61Updated this week
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆91Updated 9 months ago
• remichu-ai / gallama
  ☆130Updated 2 weeks ago
• aikitoria / open-gpu-kernel-modules
  NVIDIA Linux open GPU with P2P support
  ☆22Updated 2 weeks ago
• severian42 / MoA-Ollama-Chat
  This is the Mixture-of-Agents (MoA) concept, adapted from the original work by TogetherAI. My version is tailored for local model usage a…
  ☆115Updated 10 months ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆86Updated this week
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆77Updated this week
• Toy-97 / Chat-WebUI
  Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools.
  ☆29Updated 2 months ago
• gpustack / gguf-parser-go
  Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
  ☆161Updated this week
• fairydreaming / llama.cpp
  LLM inference in C/C++
  ☆21Updated last month
• grctest / Electron-BitNet
  Running Microsoft's BitNet via Electron, React & Astro
  ☆38Updated 3 weeks ago
• theroyallab / YALS
  ☆69Updated this week
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆182Updated last year
• d0rc / deepdive
  Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…
  ☆42Updated 8 months ago
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆103Updated last month
• KevlarKanou / rwkv7.c
  Inference RWKV v7 in pure C.
  ☆33Updated last month
• l33tkr3w / LlamaCards
  LlamaCards is a web application that provides a dynamic interface for interacting with LLM models in real-time. This app allows users to …
  ☆39Updated 8 months ago
• groq / groqflow
  GroqFlow provides an automated tool flow for compiling machine learning and linear algebra workloads into Groq programs and executing tho…
  ☆109Updated 2 months ago
• matatonic / openedai-images
  An OpenAI API compatible images server to generate or manipulate images.
  ☆16Updated 3 months ago
• zhuzilin / faster-nougat
  Implementation of nougat that focuses on processing pdf locally.
  ☆81Updated 4 months ago
• TesslateAI / TFrameX
  ☆94Updated this week
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• lucasavila00 / LmScript
  Controllable Language Model Interactions in TypeScript
  ☆9Updated 11 months ago
• the-crypt-keeper / LLooM
  Experimental LLM Inference UX to aid in creative writing
  ☆116Updated 5 months ago
• cduk / vllm-pascal
  A fork of vLLM enabling Pascal architecture GPUs
  ☆28Updated 2 months ago
• matteoserva / GraphLLM
  ☆202Updated 3 weeks ago