Alternatives and similar repositories for RKLLM-Gradio

Users that are interested in RKLLM-Gradio are comparing it to the libraries listed below

• open-webui / scripts
  ☆15Updated 8 months ago
• BoredBrownBear / text-generation-webui-model_ducking
  An extension for oobabooga/text-generation-webui that automatically unloads and reloads your model.
  ☆17Updated last year
• moonshine-ai / ai_in_a_box
  Open source repo for AI in a Box.
  ☆71Updated last year
• pomoke / torch-apu-helper
  Make PyTorch models at least run on APUs.
  ☆56Updated 2 years ago
• spectral-compute / scale-docs
  ☆62Updated last week
• 9cb14c1ec0 / ollama-vulkan
  Fork of ollama for vulkan support
  ☆20Updated 9 months ago
• welniak / llama-explain
  llama explain chrome extension
  ☆13Updated 2 years ago
• cyan2k / llama.cpp
  LLM inference in C/C++
  ☆23Updated last year
• whyvl / ollama-vulkan
  Fork of ollama for vulkan support
  ☆108Updated 11 months ago
• kvoloshenko / LMRAG_01
  LM Studio: RAG (Retrieval-Augmented Generation) Local LLM vs GPT-4
  ☆21Updated 2 years ago
• seapoe1809 / Health_server
  The new DARNA. HI Version2.5. Aspires to be your self hosted Personal Health concierge on Linux. pwd 'health'
  ☆47Updated 4 months ago
• lemonade-sdk / infinity-arcade
  Let's have some retro gaming fun with AI! Join the discord: https://discord.gg/5xXzkMu8Zk
  ☆61Updated 2 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆87Updated this week
• stippi / voice-assistant
  A Voice Assistant in your Browser.
  ☆23Updated 8 months ago
• jcosta33 / client-llm-vite
  ☆45Updated last year
• DefamationStation / Retrochat-v2
  RetroChat is a powerful command-line interface for interacting with various AI language models. It provides a seamless experience for eng…
  ☆84Updated 6 months ago
• m18coppola / llama.sh
  No-messing-around sh client for llama.cpp's server
  ☆30Updated last year
• sammcj / homeassistant-localai
  LocalAI integration component for Home Assistant
  ☆44Updated 2 years ago
• sanctuary-systems-com / llama_multiserver
  A proxy that hosts multiple single-model runners such as LLama.cpp and vLLM
  ☆12Updated 7 months ago
• PasiKoodaa / Chat-with-Screen
  ☆20Updated last year
• Nondzu / LlamaTor
  LlamaTor: Decentralized AI model sharing via BitTorrent for efficient, user-friendly distribution and collaboration.
  ☆55Updated last year
• dilzilla / LlamaSum
  Simple Summarizer Tool using Llama 3 8b.
  ☆10Updated last year
• OpenVoiceOS / ovos-tts-plugin-piper
  ☆34Updated last month
• cp3249 / splaa
  SPLAA is an AI assistant framework that utilizes voice recognition, text-to-speech, and tool-calling capabilities to provide a conversati…
  ☆28Updated 8 months ago
• Picovoice / pico-cookbook
  Recipes for on-device voice AI and local LLM
  ☆103Updated this week
• opencloud-eu / reva
  WebDAV/gRPC/HTTP high performance server to link high level clients to storage backends
  ☆19Updated this week
• charyan / osh
  Ollama Shell Helper (osh) : English to Unix-like Shell Commands translation using Local LLMs with Ollama
  ☆42Updated 2 years ago
• jryebread / LLMBenchMark
  Like system requirements lab but for LLMs
  ☆31Updated 2 years ago
• sammcj / moa
  Mixture-of-Ollamas
  ☆30Updated last year
• intel / llm-scaler
  ☆119Updated last week