Alternatives and similar repositories for RKLLM-Gradio

Users that are interested in RKLLM-Gradio are comparing it to the libraries listed below

• ThanabordeeN / Screenshot_LLM
  Screenshot LLM is a Python application that leverages the power of AI to analyze screenshots. Built with PyQt6 for a user-friendly interf…
  ☆42Updated 7 months ago
• c0zaut / RKLLM-Gradio
  ☆49Updated 4 months ago
• ericcurtin / podman-ollama
  ☆43Updated 11 months ago
• dilzilla / LlamaSum
  Simple Summarizer Tool using Llama 3 8b.
  ☆10Updated last year
• ObservedObserver / claude-minecraft-use
  A demo of cluade computer use playing minecraft
  ☆22Updated 8 months ago
• ysfemreAlbyrk / ollama-monitor
  Simple system tray application to monitor the status of your LLM models running on Ollama
  ☆20Updated 6 months ago
• simonfrey / ollama-registry-pull-through-proxy
  A proxy that allows you to host ollama images in your local environment
  ☆33Updated 11 months ago
• stippi / voice-assistant
  A Voice Assistant in your Browser.
  ☆22Updated last month
• cjpais / LocalScore
  LocalScore is an open benchmark which helps you understand how well your computer can handle local AI tasks.
  ☆44Updated last week
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆67Updated last week
• sasha0552 / nvidia-pstate
  A library and CLI utilities for managing performance states of NVIDIA GPUs.
  ☆27Updated 8 months ago
• aymanelotfi / monika
  Monika is an AI assistant that combines speech-to-text, natural language processing, and text-to-speech capabilities for seamless interac…
  ☆24Updated 2 months ago
• Danmoreng / llm-pen
  ☆16Updated 8 months ago
• exo-explore / evML
  Resources regarding evML (edge verified machine learning)
  ☆17Updated 5 months ago
• syedazharmbnr1 / ClaudeMCPServer
  MCP Server implementation for Claude
  ☆25Updated 6 months ago
• open-webui / llama-cpp-runner
  ☆22Updated 2 months ago
• sedwards2009 / llm-multitool
  Web UI for working with large language models
  ☆33Updated last year
• lemonade-sdk / lemonade
  Local LLM Server with GPU and NPU Acceleration
  ☆138Updated last week
• grll / open-mcp-proxy
  An open source MCP proxy.
  ☆13Updated 5 months ago
• ivostoykov / AIWebFormFill
  ☆12Updated 3 months ago
• extopico / llama-server_mcp_proxy
  Simple node proxy for llama-server that enables MCP use
  ☆13Updated last month
• shinomakoi / AI-Messenger
  A QT GUI for large language models
  ☆35Updated last year
• Ce-daros / ai-bash-response
  ☆11Updated last year
• BoredBrownBear / text-generation-webui-model_ducking
  An extension for oobabooga/text-generation-webui that automatically unloads and reloads your model.
  ☆17Updated last year
• OpenVoiceOS / ovos-tts-plugin-piper
  ☆25Updated last week
• Nondzu / LlamaTor
  LlamaTor: Decentralized AI model sharing via BitTorrent for efficient, user-friendly distribution and collaboration.
  ☆48Updated 5 months ago
• cp3249 / splaa
  SPLAA is an AI assistant framework that utilizes voice recognition, text-to-speech, and tool-calling capabilities to provide a conversati…
  ☆27Updated last month
• Vali-98 / cui-llama.rn
  React Native binding of llama.cpp
  ☆30Updated 3 weeks ago
• sanctuary-systems-com / llama_multiserver
  A proxy that hosts multiple single-model runners such as LLama.cpp and vLLM
  ☆11Updated 3 weeks ago
• PasiKoodaa / Chat-with-Screen
  ☆19Updated 8 months ago