Alternatives and similar repositories for MultiAMDGPU_AIDev_Ubuntu:

Users that are interested in MultiAMDGPU_AIDev_Ubuntu are comparing it to the libraries listed below

• yoziru / nextjs-vllm-ui
  Fully-featured, beautiful web interface for vLLM - built with NextJS.
  ☆110Updated 6 months ago
• chigkim / Ollama-MMLU-Pro
  ☆77Updated 2 months ago
• EmbeddedLLM / embeddedllm
  EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU
  ☆32Updated 4 months ago
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆58Updated 3 weeks ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆82Updated 6 months ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆88Updated this week
• EdwardDali / EntropixLab
  entropix style sampling + GUI
  ☆25Updated 3 months ago
• xaedes / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆20Updated last year
• cognitivecomputations / kraken
  ☆65Updated 8 months ago
• Nero10578 / LLM-Inference-Benchmark
  ☆14Updated 5 months ago
• amirrezasalimi / synthify
  Synthify: Seamlessly generate ai datasets with a no-code UI | https://synthify.toolstack.run
  ☆48Updated 2 weeks ago
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆226Updated 2 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆155Updated this week
• d0rc / deepdive
  Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…
  ☆36Updated 5 months ago
• fairydreaming / llama.cpp
  LLM inference in C/C++
  ☆14Updated this week
• agiresearch / CoRE
  LLM as Interpreter for Natural Language Programming, Pseudo-code Programming and Flow Programming of AI Agents
  ☆35Updated 6 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆53Updated this week
• abgulati / kosmos-2_5-containerized
  Kosmos-2.5 is a cutting-edge Multimodal-LLM (MLLM) specializing in image OCR. However, its stringent software requirements & Python-scrip…
  ☆58Updated 7 months ago
• 7ozzam / cohere-toolkit-with-openai
  Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.
  ☆26Updated last month
• zhuzilin / faster-nougat
  Implementation of nougat that focuses on processing pdf locally.
  ☆79Updated last month
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆124Updated 3 weeks ago
• agi-dude / chainlit-rag
  ☆28Updated 4 months ago
• RobinQu / instinct.cpp
  instinct.cpp provides ready to use alternatives to OpenAI Assistant API and built-in utilities for developing AI Agent applications (RAG,…
  ☆42Updated 7 months ago
• janhq / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆42Updated 4 months ago
• abhisheknair10 / llama3.cu
  Lightweight Llama 3 8B Inference Engine in CUDA C
  ☆46Updated last week
• GreenBitAI / green-bit-llm
  A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.
  ☆80Updated 2 weeks ago
• severian42 / MoA-Ollama-Chat
  This is the Mixture-of-Agents (MoA) concept, adapted from the original work by TogetherAI. My version is tailored for local model usage a…
  ☆110Updated 7 months ago
• AtakanTekparmak / agento
  Very minimal (and stateless) agent framework
  ☆41Updated last month
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆89Updated last month
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆130Updated this week