superjamie / rocswap
llama.cpp + ROCm + llama-swap
☆19Updated 3 months ago
Alternatives and similar repositories for rocswap
Users that are interested in rocswap are comparing it to the libraries listed below
Sorting:
- ☆57Updated last year
- Simple system tray application to monitor the status of your LLM models running on Ollama☆19Updated 5 months ago
- ☆56Updated 2 years ago
- Update your Ollama models to their latest versions with Bun!☆17Updated 6 months ago
- A local-first LLM development studio. Build, test, and customize inference workflows with your own models — no cloud, totally local.☆15Updated this week
- Effortlessly deploy a hardware-passthrough (VFIO) setup for Virtual Machines (VMs) on a Linux desktop. Includes quality-of-life features …☆18Updated last month
- A utility that uses Whisper to transcribe videos and various translation APIs to translate the transcribed text and save them as SRT (sub…☆72Updated 8 months ago
- CachyOS for Handhelds☆31Updated last week
- An extension for oobabooga/text-generation-webui that automatically unloads and reloads your model.☆17Updated last year
- Kernel/Qemu Patches for Venus.☆32Updated 8 months ago
- reddacted lets you analyze & sanitize your online footprint using LLMs, PII detection & sentiment analysis to identify anything that migh…☆86Updated last week
- an auto-sleeping and -waking framework around llama.cpp☆11Updated 3 months ago
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆61Updated this week
- A virtual input library: supports mouse, keyboard, joypad, trackpad and more☆38Updated last week
- V.I.S.O.R., my in-development AI-powered voice assistant with integrated memory!☆35Updated 3 weeks ago
- A graphical front end for Distrobox.☆23Updated last year
- A tool to list devices in iommu groups, useful for setting up VFIO☆36Updated 10 months ago
- Add-on for the Web Search extension that provides the web browsing capabilities without the need for Extras API.☆36Updated last month
- Tools to support Signed Kernel Modules with DKMS in Arch Linux☆16Updated 7 months ago
- Taskbar Launcher for [WinApps](https://github.com/winapps-org/winapps).☆33Updated 2 months ago
- Lightweight Inference server for OpenVINO☆165Updated last week
- A library and CLI utilities for managing performance states of NVIDIA GPUs.☆26Updated 7 months ago
- ☆38Updated 9 months ago
- Make PyTorch models at least run on APUs.☆54Updated last year
- Service for creating bootable USB storage devices at community conference kiosks☆33Updated this week
- Non-intimidating guide to create a KVM GPU Passthrough via libvirt/virt-manager on systems with only one GPU.☆100Updated last year
- A GUI tool to manage NVidia GPUs overclock, fans and power limit. Supports both Wayland and X11☆53Updated 2 weeks ago
- A complete install script for the complete AMD ROCm ML stack allowing you to get the most out of your hardware with the least amount of s…☆18Updated last week
- ☆42Updated 9 months ago
- LLM playground to experiment with local models and build fine-tuning datasets and benchmarks☆41Updated 2 months ago