Alternatives and similar repositories for ipex-arc-fastchat

Users that are interested in ipex-arc-fastchat are comparing it to the libraries listed below

• SearchSavior / OpenArc
  Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.
  ☆241Updated last week
• mattcurf / ollama-intel-gpu
  ☆257Updated 5 months ago
• linuxserver / docker-kasm
  Kasm Workspaces platform provides enterprise-class orchestration, data loss prevention, and web streaming technology to enable the delive…
  ☆424Updated this week
• lhl / strix-halo-testing
  ☆138Updated 3 weeks ago
• nktice / AMD-AI
  AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
  ☆216Updated 2 weeks ago
• sbnb-io / sbnb
  Linux distro for AI computers. Go from bare-metal GPUs to running AI workloads - like vLLM, SGLang, RAG, and Agents - in minutes, fully a…
  ☆315Updated 2 months ago
• kyuz0 / amd-strix-halo-toolboxes
  ☆524Updated this week
• JingShing / How-to-use-tesla-p40
  A manual for helping using tesla p40 gpu
  ☆137Updated last year
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆1,329Updated this week
• aidatatools / ollama-benchmark
  LLM Benchmark for Throughput via Ollama (Local LLMs)
  ☆311Updated 3 months ago
• wvthoog / proxmox-vgpu-installer
  ☆241Updated last year
• sasha0552 / nvidia-pstated
  A daemon that automatically manages the performance states of NVIDIA GPUs.
  ☆97Updated 2 weeks ago
• sasha0552 / nvidia-pstate
  A library and CLI utilities for managing performance states of NVIDIA GPUs.
  ☆31Updated last year
• nothingmn / echonotes
  Welcome to echonotes! This is an exciting and powerful Python application designed to automate the process of extracting handwritten note…
  ☆63Updated last year
• Disty0 / intel-arc-monitor
  A script to monitor Intel ARC GPUs on Linux
  ☆26Updated 2 years ago
• FastFlowLM / FastFlowLM
  Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.
  ☆451Updated this week
• rjmacarthy / twinny-api
  Locally hosted AI code completion server. Like Github Copilot but 100% free and 100% private.
  ☆109Updated last year
• geerlingguy / ai-benchmarks
  Simple AI/LLM benchmarking tools.
  ☆155Updated last week
• zhaohb / ollama_ov
  Add genai backend for ollama to run generative AI models using OpenVINO Runtime.
  ☆18Updated 5 months ago
• amd / gaia
  Run LLM Agents on Ryzen AI PCs in Minutes
  ☆744Updated this week
• kalavai-net / kalavai-client
  A platform to self-host AI on easy mode
  ☆176Updated last week
• geerlingguy / beowulf-ai-cluster
  AI Cluster deployed with Ansible on Random computers with random capabilities
  ☆273Updated 2 months ago
• sakakun / Proxmox-Desktop-Client
  A windows desktop client for Proxmox.
  ☆148Updated 10 months ago
• 11notes / docker-netbird
  Run netbird rootless and distroless from a single image.
  ☆98Updated this week
• crashr / gppm
  GPU Power and Performance Manager
  ☆61Updated last year
• debloper / xplex
  The renaissance will be multi-streamed LIVE—with xplex!
  ☆214Updated 2 months ago
• mixa3607 / ML-gfx906
  ML software (llama.cpp, ComfyUI, vLLM) builds for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60
  ☆53Updated last week
• Rishabh-Bajpai / Chanakya-Local-Friend
  Chanakya is an advanced, open-source, and self-hostable voice assistant designed for privacy, power, and flexibility. It leverages local …
  ☆164Updated 2 months ago
• Rahn-IT / traefik-gui
  A simple GUI for configuring traefik routes
  ☆128Updated 2 months ago
• hassancs91 / minio-windows-client
  Electron Based Desktop App To Manage Minio Community Edition
  ☆35Updated 4 months ago