Alternatives and similar repositories for ipex-arc-fastchat:

Users that are interested in ipex-arc-fastchat are comparing it to the libraries listed below

• sasha0552 / nvidia-pstate
  A library and CLI utilities for managing performance states of NVIDIA GPUs.
  ☆25Updated 5 months ago
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆143Updated this week
• mattcurf / ollama-intel-gpu
  ☆191Updated 2 weeks ago
• AaronFeng753 / Ollama-Model-Dumper
  Export and Backup Ollama models into GGUF and ModelFile
  ☆63Updated 6 months ago
• sasha0552 / nvidia-pstated
  A daemon that automatically manages the performance states of NVIDIA GPUs.
  ☆64Updated 5 months ago
• crashr / gppm
  GPU Power and Performance Manager
  ☆57Updated 5 months ago
• JingShing / How-to-use-tesla-p40
  A manual for helping using tesla p40 gpu
  ☆121Updated 4 months ago
• nktice / AMD-AI
  AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
  ☆200Updated last month
• onnx / turnkeyml
  LLM SDK for OnnxRuntime GenAI (OGA)
  ☆119Updated this week
• Shreyas9400 / SearXNG-WebSearch-AI
  AI powered Chatbot with real time updates.
  ☆50Updated 5 months ago
• nothingmn / echonotes
  Welcome to echonotes! This is an exciting and powerful Python application designed to automate the process of extracting handwritten note…
  ☆47Updated 6 months ago
• srikanth235 / benchllama
  Benchmark your local LLMs.
  ☆45Updated 7 months ago
• mpazdzioch / llamacpp-webui-glue
  ☆27Updated last month
• LuciAkirami / liva
  LIVA - Local Intelligent Voice Assistant
  ☆61Updated 7 months ago
• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆142Updated this week
• Rahn-IT / traefik-gui
  A simple GUI for configuring traefik routes
  ☆90Updated last month
• sshh12 / llm-chat-web-ui
  LLM Chat is an open-source serverless alternative to ChatGPT.
  ☆33Updated 6 months ago
• j4ys0n / local-ai-stack
  Open WebUI, ComfyUI, n8n, LocalAI, LLM Proxy, SearXNG, Qdrant, Postgres all in docker compose
  ☆49Updated 5 months ago
• intel / intel-npu-acceleration-library
  Intel® NPU Acceleration Library
  ☆653Updated 2 months ago
• aidatatools / ollama-benchmark
  LLM Benchmark for Throughput via Ollama (Local LLMs)
  ☆204Updated last month
• cloudmercato / ollama-benchmark
  Handy tool to measure the performance and efficiency of LLMs workloads.
  ☆52Updated 2 months ago
• eleiton / ollama-intel-arc
  Make use of Intel Arc Series GPU to Run Ollama, StableDiffusion and Open WebUI, for image generation and interaction with Large Language …
  ☆17Updated last week
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆87Updated this week
• sbnb-io / sbnb
  Linux distro for AI computers
  ☆159Updated last week
• ipv6rslimited / cloudseeder
  One-click install internet appliances that operate on your terms. Transform your home computer into a sovereign and secure cloud.
  ☆141Updated 5 months ago
• mzbac / AutoGPTQ-API
  Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.
  ☆91Updated last year
• mostlygeek / llama-swap
  transparent proxy server on demand model swapping for llama.cpp (or any local OpenAPI compatible server)
  ☆482Updated last week
• intel / xpumanager
  ☆103Updated 2 weeks ago
• geerlingguy / ollama-benchmark
  Simple ollama benchmarking tool.
  ☆98Updated last month
• EtiennePerot / safe-code-execution
  Code execution utilities for Open WebUI & Ollama
  ☆264Updated 4 months ago