Alternatives and similar repositories for gaia

Users that are interested in gaia are comparing it to the libraries listed below

• FastFlowLM / FastFlowLM
  Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.
  ☆689Updated last week
• lemonade-sdk / lemonade
  Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https…
  ☆2,113Updated this week
• ROCm / TheRock
  The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm
  ☆759Updated last week
• intel / AI-Playground
  AI PC starter app for doing AI image creation, image stylizing, and chatbot on a PC powered by an Intel® Arc™ GPU.
  ☆727Updated last week
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆1,587Updated this week
• SearchSavior / OpenArc
  Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.
  ☆290Updated last week
• amd / RyzenAI-SW
  AMD Ryzen™ AI Software includes the tools and runtime libraries for optimizing and deploying AI inference on AMD Ryzen™ AI powered PCs.
  ☆763Updated 2 weeks ago
• onnx / turnkeyml
  No-code CLI designed for accelerating ONNX workflows
  ☆227Updated 7 months ago
• lemonade-sdk / llamacpp-rocm
  Fresh builds of llama.cpp with AMD ROCm™ 7 acceleration
  ☆187Updated this week
• lamikr / rocm_sdk_builder
  ☆428Updated 10 months ago
• kyuz0 / amd-strix-halo-toolboxes
  ☆911Updated this week
• lhl / strix-halo-testing
  ☆196Updated 3 months ago
• nktice / AMD-AI
  AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
  ☆217Updated this week
• intel / llm-scaler
  ☆144Updated this week
• mostlygeek / llama-swap
  Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc
  ☆2,311Updated this week
• huawei-csl / SINQ
  Welcome to the official repository of SINQ! A novel, fast and high-quality quantization method designed to make any Large Language Model …
  ☆590Updated 3 weeks ago
• ggml-org / llama.vscode
  VS Code extension for LLM-assisted code/text completion
  ☆1,150Updated 3 weeks ago
• iuliaturc / gguf-docs
  Docs for GGUF quantization (unofficial)
  ☆366Updated 6 months ago
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆626Updated last week
• intel / intel-ai-super-builder
  Intel® AI Super Builder
  ☆156Updated last week
• AMD-AGI / Instella
  Fully Open Language Models with Stellar Performance
  ☆318Updated 2 months ago
• gpustack / gguf-parser-go
  Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
  ☆238Updated last month
• ipex-llm / ipex-llm
  Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V,…
  ☆82Updated 9 months ago
• intel / intel-npu-acceleration-library
  Intel® NPU Acceleration Library
  ☆703Updated 9 months ago
• openvinotoolkit / openvino.genai
  Run Generative AI models with simple C++/Python API and using OpenVINO Runtime
  ☆428Updated this week
• aidatatools / ollama-benchmark
  LLM Benchmark for Throughput via Ollama (Local LLMs)
  ☆329Updated 3 weeks ago
• alexziskind1 / llm-inference-calculator
  ☆148Updated 4 months ago
• kyuz0 / amd-strix-halo-vllm-toolboxes
  ☆123Updated this week
• alexhegit / Playing-with-ROCm
  See how to play with ROCm, run it with AMD GPUs!
  ☆39Updated this week
• YellowRoseCx / koboldcpp-rocm
  AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading
  ☆737Updated last month