Alternatives and similar repositories for RKLLM-Gradio

Users that are interested in RKLLM-Gradio are comparing it to the libraries listed below

• pomoke / torch-apu-helper
  Make PyTorch models at least run on APUs.
  ☆57Updated last year
• whyvl / ollama-vulkan
  Fork of ollama for vulkan support
  ☆107Updated 8 months ago
• 9cb14c1ec0 / ollama-vulkan
  Fork of ollama for vulkan support
  ☆20Updated 6 months ago
• cjpais / LocalScore
  LocalScore is an open benchmark which helps you understand how well your computer can handle local AI tasks.
  ☆65Updated 2 months ago
• alxpez / alts
  100% free, local & offline voice assistant with speech recognition
  ☆75Updated last year
• c0zaut / RKLLM-Gradio
  ☆49Updated 8 months ago
• DefamationStation / Retrochat-v2
  RetroChat is a powerful command-line interface for interacting with various AI language models. It provides a seamless experience for eng…
  ☆81Updated 3 months ago
• segurac / force-host-alloction-APU
  ☆62Updated 5 months ago
• cocktailpeanut / AudioSep.pinokio
  ☆10Updated 8 months ago
• moonshine-ai / ai_in_a_box
  Open source repo for AI in a Box.
  ☆68Updated last year
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆82Updated last week
• ericcurtin / podman-ollama
  ☆45Updated last month
• ollama-webui / ollama-modelfiles
  Ollama Modelfiles - Discover more at OllamaHub
  ☆20Updated last year
• Merkoba / Meltdown
  An interface for llama.cpp, ChatGPT, Gemini, and Claude
  ☆27Updated this week
• kvoloshenko / LMRAG_01
  LM Studio: RAG (Retrieval-Augmented Generation) Local LLM vs GPT-4
  ☆22Updated last year
• Picovoice / pico-cookbook
  Recipes for on-device voice AI and local LLM
  ☆98Updated 4 months ago
• sammcj / homeassistant-localai
  LocalAI integration component for Home Assistant
  ☆43Updated 2 years ago
• OpenVoiceOS / ovos-tts-plugin-piper
  ☆32Updated this week
• teabranch / open-responses-server
  Wraps any OpenAI API interface as Responses with MCPs support so it supports Codex. Adding any missing stateful features. Ollama and Vllm…
  ☆126Updated this week
• open-webui / scripts
  ☆14Updated 6 months ago
• spectral-compute / scale-docs
  ☆61Updated last week
• electroglyph / quant_clone
  Generate a llama-quantize command to copy the quantization parameters of any GGUF
  ☆25Updated 3 months ago
• qrv0 / llm-ripper
  LLM Ripper is a framework for component extraction (embeddings, attention heads, FFNs), activation capture, functional analysis, and adap…
  ☆45Updated last week
• shinomakoi / AI-Messenger
  A QT GUI for large language models
  ☆39Updated last year
• ysfemreAlbyrk / ollama-monitor
  Simple system tray application to monitor the status of your LLM models running on Ollama
  ☆23Updated 4 months ago
• kroko-ai / kroko-onnx
  Kroko ASR - Speech-to-text
  ☆100Updated last month
• PasiKoodaa / Chat-with-Screen
  ☆20Updated last year
• sammcj / vlm-ui
  Web Interface for Vision Language Models Including InternVLM2
  ☆23Updated last year
• probonopd / static-tools
  Building static binaries of some tools using an Alpine chroot with musl
  ☆34Updated this week
• sammcj / moa
  Mixture-of-Ollamas
  ☆30Updated last year