Alternatives and similar repositories for scuda

Users that are interested in scuda are comparing it to the libraries listed below

• Lizonghang / prima.cpp
  prima.cpp: Speeding up 70B-scale LLM inference on low-resource everyday home clusters
  ☆945Updated this week
• evilsocket / cake
  Distributed LLM and StableDiffusion inference for mobile, desktop and server.
  ☆2,859Updated 8 months ago
• microsandbox / microsandbox
  Self-Hosted Plaform for Secure Execution of Untrusted User/AI Code
  ☆2,668Updated 2 weeks ago
• rzane / docker2exe
  Convert a Docker image to an executable
  ☆1,574Updated last month
• subtrace / subtrace
  Wireshark for Docker containers
  ☆2,485Updated this week
• b4rtaz / distributed-llama
  Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
  ☆2,189Updated last week
• distantmagic / paddler
  Stateful load balancer custom-tailored for llama.cpp 🏓🦙
  ☆782Updated this week
• doxx / darkflare
  DarkFlare Firewall Piercing (TCP over CDN)
  ☆1,397Updated 5 months ago
• ggml-org / llama.vscode
  VS Code extension for LLM-assisted code/text completion
  ☆807Updated this week
• menloresearch / ichigo
  Local realtime voice AI
  ☆2,328Updated 3 months ago
• Devolutions / IronRDP
  Rust implementation of the Microsoft Remote Desktop Protocol (RDP)
  ☆2,555Updated last week
• mikex86 / LibreCuda
  ☆1,041Updated last month
• varnish / tinykvm
  VMM for native-performance sandboxing
  ☆604Updated this week
• bytebot-ai / bytebot
  Bytebot is the container for desktop agents.
  ☆727Updated this week
• skyzh / tiny-llm
  A course of learning LLM inference serving on Apple Silicon for systems engineers.
  ☆2,598Updated last week
• joanrod / star-vector
  StarVector is a foundation model for SVG generation that transforms vectorization into a code generation task. Using a vision-language mo…
  ☆3,912Updated 2 months ago
• lifeiteng / OmniSenseVoice
  Omni SenseVoice: High-Speed Speech Recognition with words timestamps 🗣️🎯
  ☆851Updated 3 months ago
• goodreasonai / ScrapeServ
  A self-hosted API that takes a URL and returns a file with browser screenshots.
  ☆977Updated 3 months ago
• farshed / sage
  Self-hosted voice chat with LLMs
  ☆432Updated 3 months ago
• malmeloo / FindMy.py
  🍏 + 🎯 + 🐍 = Query Apple's FindMy Network with Python!
  ☆2,147Updated last week
• tinygrad / open-gpu-kernel-modules
  NVIDIA Linux open GPU with P2P support
  ☆1,175Updated 2 weeks ago
• akdeb / ElatoAI
  Realtime AI speech with OpenAI Realtime API and Gemini Live API on Arduino ESP32 with Secure Websockets and Deno edge functions with >15 …
  ☆1,044Updated last week
• fixie-ai / ultravox
  A fast multimodal LLM for real-time voice
  ☆4,030Updated 4 months ago
• arkohut / pensieve
  A passive recording project allows you to have complete control over your data. Automatically take screenshots of all your screens, index…
  ☆1,264Updated 2 weeks ago
• perone / vectorvfs
  Your filesystem as a vector database
  ☆377Updated last month
• monasticacademy / httptap
  View HTTP/HTTPS requests made by any Linux program
  ☆4,022Updated 2 months ago
• huggingface / smollm
  Everything about the SmolLM2 and SmolVLM family of models
  ☆2,574Updated 2 months ago
• bodo-run / yek
  A fast Rust based tool to serialize text-based files in a repository or directory for LLM consumption
  ☆2,149Updated 2 weeks ago
• google-ai-edge / model-explorer
  A modern model graph visualizer and debugger
  ☆1,261Updated this week
• yassinebenaid / bunster
  Compile shell scripts to static binaries.
  ☆2,405Updated last month