Alternatives and similar repositories for MultiAMDGPU_AIDev_Ubuntu:

Users that are interested in MultiAMDGPU_AIDev_Ubuntu are comparing it to the libraries listed below

• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆87Updated 8 months ago
• chigkim / Ollama-MMLU-Pro
  ☆83Updated 3 months ago
• TechxGenus / CursorCore
  CursorCore: Assist Programming through Aligning Anything
  ☆117Updated last month
• phildougherty / qwen2.5_omni_chat
  Service for testing out the new Qwen2.5 omni model
  ☆17Updated last week
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆231Updated this week
• moxin-org / Moxin-LLM
  Moxin is a family of fully open-source and reproducible LLMs
  ☆85Updated 2 weeks ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆164Updated this week
• guidance-ai / jsonschemabench
  ☆23Updated this week
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆154Updated this week
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆143Updated this week
• abhisheknair10 / llama3.cu
  Lightweight Llama 3 8B Inference Engine in CUDA C
  ☆47Updated last week
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆67Updated last week
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆55Updated last month
• agiresearch / CoRE
  LLM as Interpreter for Natural Language Programming, Pseudo-code Programming and Flow Programming of AI Agents
  ☆38Updated 8 months ago
• deepgrove-ai / Bonsai
  ☆17Updated last week
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆177Updated 8 months ago
• OoriData / Toolio
  GenAI & agent toolkit for Apple Silicon Mac, implementing JSON schema-steered structured output (3SO) and tool-calling in Python. For mor…
  ☆118Updated last month
• Jaykef / mlx-rag-gguf
  Minimal, clean code implementation of RAG with mlx using gguf model weights
  ☆49Updated 11 months ago
• beratcmn / local-intelligence
  Something similar to Apple Intelligence?
  ☆59Updated 9 months ago
• anjor / ollama-mcp-client
  ☆37Updated 3 months ago
• fairydreaming / llama.cpp
  LLM inference in C/C++
  ☆19Updated last week
• zhuzilin / faster-nougat
  Implementation of nougat that focuses on processing pdf locally.
  ☆81Updated 2 months ago
• GreenBitAI / green-bit-llm
  A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.
  ☆81Updated 3 weeks ago
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆76Updated 3 months ago
• akx / ggify
  Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp
  ☆128Updated 6 months ago
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆136Updated this week
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆115Updated 10 months ago
• yoziru / nextjs-vllm-ui
  Fully-featured, beautiful web interface for vLLM - built with NextJS.
  ☆118Updated last week
• remichu-ai / gallama
  ☆125Updated last week
• evintunador / minGemma
  a simplified version of Google's Gemma model to be used for learning
  ☆24Updated last year