Alternatives and similar repositories for ipex-arc-fastchat

Users that are interested in ipex-arc-fastchat are comparing it to the libraries listed below

• mattcurf / ollama-intel-gpu
  ☆257Updated 7 months ago
• SearchSavior / OpenArc
  Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.
  ☆274Updated last week
• lhl / strix-halo-testing
  ☆186Updated 2 months ago
• FastFlowLM / FastFlowLM
  Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.
  ☆637Updated this week
• onnx / turnkeyml
  No-code CLI designed for accelerating ONNX workflows
  ☆224Updated 7 months ago
• aidatatools / ollama-benchmark
  LLM Benchmark for Throughput via Ollama (Local LLMs)
  ☆323Updated this week
• kyuz0 / amd-strix-halo-toolboxes
  ☆770Updated this week
• lemonade-sdk / llamacpp-rocm
  Fresh builds of llama.cpp with AMD ROCm™ 7 acceleration
  ☆164Updated this week
• geerlingguy / ai-benchmarks
  Simple AI/LLM benchmarking tools.
  ☆185Updated last month
• rjmacarthy / twinny-api
  Locally hosted AI code completion server. Like Github Copilot but 100% free and 100% private.
  ☆109Updated 2 years ago
• intel / intel-ai-super-builder
  Intel® AI Super Builder
  ☆151Updated this week
• intel / llm-scaler
  ☆136Updated this week
• amd / RyzenAI-SW
  AMD Ryzen™ AI Software includes the tools and runtime libraries for optimizing and deploying AI inference on AMD Ryzen™ AI powered PCs.
  ☆735Updated last month
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆1,511Updated this week
• Pelochus / ezrknn-llm
  Easier usage of LLMs in Rockchip's NPU on SBCs like Orange Pi 5 and Radxa Rock 5 series
  ☆167Updated 5 months ago
• sbnb-io / sbnb
  Linux distro for AI computers. Go from bare-metal GPUs to running AI workloads - like vLLM, SGLang, RAG, and Agents - in minutes, fully a…
  ☆330Updated last month
• nktice / AMD-AI
  AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
  ☆216Updated last month
• AaronFeng753 / Ollama-Model-Dumper
  Export and Backup Ollama models into GGUF and ModelFile
  ☆90Updated last year
• PenningLabs / lxconsole
  LXD Graphical Web Console
  ☆403Updated last month
• amd / gaia
  Build AI agents for your PC
  ☆885Updated this week
• rikkichy / ollama-telegram
  🦙 Ollama Telegram bot, with advanced configuration
  ☆400Updated 4 months ago
• eleiton / ollama-intel-arc
  Make use of Intel Arc Series GPU to Run Ollama, StableDiffusion, Whisper and Open WebUI, for image generation, speech recognition and int…
  ☆224Updated last month
• sasha0552 / nvidia-pstated
  A daemon that automatically manages the performance states of NVIDIA GPUs.
  ☆109Updated 2 months ago
• iohub / collama
  VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.
  ☆183Updated 11 months ago
• JingShing / How-to-use-tesla-p40
  A manual for helping using tesla p40 gpu
  ☆140Updated last year
• intel / AI-Playground
  AI PC starter app for doing AI image creation, image stylizing, and chatbot on a PC powered by an Intel® Arc™ GPU.
  ☆710Updated this week
• wvthoog / proxmox-vgpu-installer
  ☆246Updated last year
• sakakun / Proxmox-Desktop-Client
  A windows desktop client for Proxmox.
  ☆152Updated last year
• Gimer-Studios / APIMyLlama
  API up your Ollama Server.
  ☆191Updated 2 weeks ago
• geerlingguy / beowulf-ai-cluster
  AI Cluster deployed with Ansible on Random computers with random capabilities
  ☆312Updated last month