Dynamic LLM model swapping system with Docker, vLLM integration, and GPU acceleration. Supports GGUF & Hugging Face models with automatic swapping and Traefik routing.
☆23Mar 6, 2026Updated 7 months ago
Alternatives and similar repositories for llama-swap-vllm-boilerplate
Users that are interested in llama-swap-vllm-boilerplate are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- nostr paid relay, but with monero decentralized, monero, nostr, relay, strfry, xmr☆30May 15, 2025Updated last year
- A local-first cognitive architecture for building a persistent digital companion with memory, reasoning, personality, and long-term learn…☆29Sep 18, 2026Updated last month
- A zero-allocation, header-only C++ BPE tokenizer for Qwen, built for maximum inference throughput.☆24Apr 3, 2026Updated 6 months ago
- 🤵 AIfred-Intelligence — self-hosted multi-agent assistant: debate modes (Symposion/Tribunal), voice (STT + streaming TTS, voice cloning)…☆39Updated this week
- A repository to store helpful information and emerging insights in regard to LLMs☆21Oct 27, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Local-first vault agent in Rust, grammar-enforced tools, markdown as memory readable for human and agent, but in principle is the agent i…☆30Sep 22, 2026Updated last month
- Chatbot-to-speech using Orpheus TTS model. Interactive console app.☆21May 1, 2025Updated last year
- Easy playback of the video content that was created using one of the Vr.cam webcam devices.☆13Dec 12, 2025Updated 10 months ago
- Fast LLM swapping with sleep/wake support, compatible with vllm, llama.cpp, etc. llama-swap fork.☆57Apr 5, 2026Updated 6 months ago
- A simple frontend page to interact with an OpenAI like API☆17Jan 31, 2025Updated last year
- Multi-dataset evaluation of Anthropic's J-Space on Qwen3-4B. Demonstrates that internal 'workspace noise' can reliably route high-confide…☆13Jul 13, 2026Updated 3 months ago
- MoFlo — an opinionated, local-first AI agent orchestration toolkit for Claude Code: semantic memory, learned routing, gates, and spells. …☆19Updated this week
- Yet another frontend for LLM, written using .NET and WinUI 3☆11Sep 14, 2025Updated last year
- tcpdump inside esp8266/Arduino and other goodies☆14Jun 21, 2019Updated 7 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Superseded by github.com/poisonxa16/pxa — PXA, the set-and-forget engine for Pascal and Volta☆24Sep 8, 2026Updated last month
- A VR180 photo viewer that works on a web browser.☆12May 18, 2019Updated 7 years ago
- NeoJS is a JavaScript scriptable NeoPixel LED Controller with an easy to use Web UI☆15May 1, 2024Updated 2 years ago
- Using CogVLM and CogAgent for image captioning☆15Dec 29, 2023Updated 2 years ago
- Simple Tool Caller for llama.cpp☆11Aug 12, 2024Updated 2 years ago
- Fork of github.com/UCSBarchlab/OpenTPU for the TGPTPU project☆14Jun 1, 2025Updated last year
- This Streamlit application allows users to upload images and engage in interactive conversations about them using the Ollama Vision Model…☆15Nov 11, 2024Updated last year
- Differential-KV (DKV) is a sparse KV-cache inference runtime designed for high-efficiency, memory-bounded long-context Large Language Mod…☆21Oct 16, 2026Updated last week
- DHT12 library for Arduino.☆10Jul 22, 2016Updated 10 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ESP32-S3 e-paper home dashboard for M5Stack PaperS3 — LVGL UI with MQTT/Home Assistant integration, touch navigation, and OTA updates.☆35Oct 16, 2026Updated last week
- A tag editor written in C# and WPF☆12Aug 20, 2023Updated 3 years ago
- Point-in-time snapshot of projects describing themselves as AI agent harnesses (April 2026)☆18Apr 4, 2026Updated 6 months ago
- A 210M text-to-image diffusion transformer trained from scratch on one GPU in 3.5 days: rectified flow on FLUX.2 latents, aspect-ratio bu…☆15Sep 9, 2026Updated last month
- Esp32 Xtensa blocker with extended russian domains☆23Oct 8, 2026Updated 2 weeks ago
- 27B at 256k context on one RTX 5090 — FP6 + 4-bit KV + MTP spec-decode, hand-written SM120 tensor-core kernels, OpenAI API.☆18Aug 18, 2026Updated 2 months ago
- ☆14Oct 31, 2023Updated 2 years ago
- M5STACK Arduino WiFi Photo Backup device☆15Feb 25, 2018Updated 8 years ago
- Bluetooth LE Keyboard & Mouse & Gamepad, compatible with Arduino Keyboard, Mouse and Gamepad☆13Dec 13, 2022Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 6 kB init.lua for NodeMCU to install lua files via wifi☆13May 5, 2015Updated 11 years ago
- Displays current weather conditions inside and out☆12Aug 3, 2015Updated 11 years ago
- PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation☆33Nov 16, 2024Updated last year
- A Streamlit app to upload files and query with DuckDB☆15Jan 18, 2024Updated 2 years ago
- ☆12Jun 22, 2015Updated 11 years ago
- ESP8266 based weather monitor with 128x32 oled display☆13Apr 15, 2019Updated 7 years ago
- Windows GUI for install apks☆12Nov 18, 2018Updated 7 years ago