Dynamic LLM model swapping system with Docker, vLLM integration, and GPU acceleration. Supports GGUF & Hugging Face models with automatic swapping and Traefik routing.
☆23Mar 6, 2026Updated 8 months ago
Alternatives and similar repositories for llama-swap-vllm-boilerplate
Users that are interested in llama-swap-vllm-boilerplate are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Remote MCP server for ChromaDB☆12Updated this week
- A zero-allocation, header-only C++ BPE tokenizer for Qwen, built for maximum inference throughput.☆24Apr 3, 2026Updated 7 months ago
- A local-first cognitive architecture for building a persistent digital companion with memory, reasoning, personality, and long-term learn…☆29Sep 18, 2026Updated last month
- A small A/B test of a laconic brevity directive on three LLMs: 54 replies to safety decisions, blinded two-scorer consensus against pre-r…☆17Aug 10, 2026Updated 3 months ago
- 🤵 AIfred-Intelligence — self-hosted multi-agent assistant: debate modes (Symposion/Tribunal), voice (STT + streaming TTS, voice cloning)…☆39Updated this week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- A repository to store helpful information and emerging insights in regard to LLMs☆21Oct 27, 2023Updated 3 years ago
- FusionQuant Model Merge & GGUF Conversion Pipeline - Your Free Toolkit for Custom LLMs!☆14Jun 24, 2025Updated last year
- Chatbot-to-speech using Orpheus TTS model. Interactive console app.☆22May 1, 2025Updated last year
- Easy playback of the video content that was created using one of the Vr.cam webcam devices.☆13Dec 12, 2025Updated 11 months ago
- Web VR video player for 180° SBS and TB videos. Option to play standard videos in cinema mode. Support for Cardboard, Oculus. Gamepad con…☆12Mar 3, 2025Updated last year
- tcpdump inside esp8266/Arduino and other goodies☆14Jun 21, 2019Updated 7 years ago
- Yet another frontend for LLM, written using .NET and WinUI 3☆11Sep 14, 2025Updated last year
- Fast LLM swapping with sleep/wake support, compatible with vllm, llama.cpp, etc. llama-swap fork.☆58Apr 5, 2026Updated 7 months ago
- An ESP8266 based WiFi lawn/garden sprinkler control system.☆11Jun 9, 2017Updated 9 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- pi-assistant is a tool-calling assistant designed for the Raspberry Pi. It can answer knowledge questions, provide weather updates, and c…☆12Oct 27, 2025Updated last year
- A simple frontend page to interact with an OpenAI like API☆17Jan 31, 2025Updated last year
- Fast TorToiSe inference (5x or your money back!)☆13Sep 4, 2023Updated 3 years ago
- Multi-dataset evaluation of Anthropic's J-Space on Qwen3-4B. Demonstrates that internal 'workspace noise' can reliably route high-confide…☆12Jul 13, 2026Updated 3 months ago
- This Streamlit application allows users to upload images and engage in interactive conversations about them using the Ollama Vision Model…☆15Nov 11, 2024Updated 2 years ago
- Using CogVLM and CogAgent for image captioning☆15Dec 29, 2023Updated 2 years ago
- DHT12 library for Arduino.☆10Jul 22, 2016Updated 10 years ago
- Simple Tool Caller for llama.cpp☆11Aug 12, 2024Updated 2 years ago
- Nerves system for Raspberry Pi 5 with support for the Hailo AI accelerator☆10Dec 16, 2024Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Fork of github.com/UCSBarchlab/OpenTPU for the TGPTPU project☆14Jun 1, 2025Updated last year
- NeoJS is a JavaScript scriptable NeoPixel LED Controller with an easy to use Web UI☆15May 1, 2024Updated 2 years ago
- A VR180 photo viewer that works on a web browser.☆12May 18, 2019Updated 7 years ago
- Docker config for vLLM GLM-4.7-Flash support with glm4_moe_lite patch☆12Jan 21, 2026Updated 9 months ago
- Simple stereo viewer for .MPO photos.☆12Feb 6, 2025Updated last year
- Bluetooth LE Keyboard & Mouse & Gamepad, compatible with Arduino Keyboard, Mouse and Gamepad☆13Dec 13, 2022Updated 3 years ago
- Xiaomi Yi, Yi 4k, Yi 4k+ Arduino ESP8266 wifi remote controller☆15Jul 26, 2018Updated 8 years ago
- ☆10Jun 20, 2026Updated 4 months ago
- Physical Cube using ESP32, Acc+Gyro and Bluetooth LE displayed in a Browser - A WebBluetooth experiment☆12Mar 30, 2018Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 3D Spiking neural network simulation exploring Spike Timing Dependent Plasticity (STDP)☆11Apr 1, 2026Updated 7 months ago
- Rust Hardware Abstraction Layer for Microchip PolarFire SoC boards, with Embassy support☆12May 7, 2026Updated 6 months ago
- ☆14Oct 31, 2023Updated 3 years ago
- a bot with personality☆14Jun 4, 2026Updated 5 months ago
- 6 kB init.lua for NodeMCU to install lua files via wifi☆13May 5, 2015Updated 11 years ago
- A Rust binding for LibHailoRS☆11Jan 18, 2025Updated last year
- Displays current weather conditions inside and out☆12Aug 3, 2015Updated 11 years ago
Are these results useful?