Dynamic LLM model swapping system with Docker, vLLM integration, and GPU acceleration. Supports GGUF & Hugging Face models with automatic swapping and Traefik routing.
☆22Mar 6, 2026Updated 4 months ago
Alternatives and similar repositories for llama-swap-vllm-boilerplate
Users that are interested in llama-swap-vllm-boilerplate are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- nostr paid relay, but with monero decentralized, monero, nostr, relay, strfry, xmr☆33May 15, 2025Updated last year
- Docker/podman container for llama.cpp/vllm/exllamav{2,3} orchestrated using llama-swap☆18Jun 17, 2026Updated 3 weeks ago
- A simple, observable code-writing agent builder in TypeScript.☆33Apr 9, 2025Updated last year
- ☆51Oct 1, 2025Updated 9 months ago
- OCR post correction for old German corpus☆20Aug 29, 2022Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- tcpdump inside esp8266/Arduino and other goodies☆14Jun 21, 2019Updated 7 years ago
- Explorations into the proposed SDFT, Self-Distillation Enables Continual Learning, from Shenfeld et al. of MIT☆31Feb 6, 2026Updated 5 months ago
- Yet another frontend for LLM, written using .NET and WinUI 3☆11Sep 14, 2025Updated 10 months ago
- An AI-powered agent utilizing LLMs (e.g., Claude) with Function Calling to automate tasks in Blender. Enhances workflow efficiency by int…☆34Mar 27, 2025Updated last year
- KoboldCpp Smart Launcher with GPU Layer and Tensor Override Tuning☆30May 18, 2025Updated last year
- Implementation of the Hierarchical Reasoning Model (HRM), applied to a pathfinding task, plus performance study.☆33Sep 9, 2025Updated 10 months ago
- My version of an LLM Websearch Agent using a local SearXNG server because SearXNG is great.☆46Jan 27, 2026Updated 5 months ago
- A VR180 photo viewer that works on a web browser.☆12May 18, 2019Updated 7 years ago
- Plan and train German transformer models.☆23Feb 22, 2021Updated 5 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Using CogVLM and CogAgent for image captioning☆15Dec 29, 2023Updated 2 years ago
- Physical Cube using ESP32, Acc+Gyro and Bluetooth LE displayed in a Browser - A WebBluetooth experiment☆12Mar 30, 2018Updated 8 years ago
- A dynamic multi-expert AI architecture running on a single consumer GPU (RTX 3060).☆36Dec 2, 2025Updated 7 months ago
- A tag editor written in C# and WPF☆12Aug 20, 2023Updated 2 years ago
- Simple Tool Caller for llama.cpp☆11Aug 12, 2024Updated last year
- Conformer block with Rotary Position Embedding, modified from lucidrains' implement☆19Sep 13, 2024Updated last year
- Zigbee Custom Firmwares for various Zigbee devices☆20Jun 7, 2026Updated last month
- Quickest way to production grade RAG UI.☆41Jun 17, 2026Updated 3 weeks ago
- MCP server and CLI tool that gives AI agents access to YouTube☆15May 23, 2026Updated last month
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- An efficient spiking variational autoencoder☆13Nov 13, 2023Updated 2 years ago
- SwiftLet is a lightweight Python framework for running open-source Large Language Models (LLMs) locally using safetensors☆29Aug 6, 2025Updated 11 months ago
- M5STACK Arduino WiFi Photo Backup device☆15Feb 25, 2018Updated 8 years ago
- ☆15Oct 31, 2023Updated 2 years ago
- Implement spike-drive using OR residual connection and propose SynA attention for natural pruning.(Under Review)☆13Mar 31, 2024Updated 2 years ago
- Carrier board for Raspberry Pi CM5 with IMU, CAN and Dynamixel support☆20Aug 5, 2025Updated 11 months ago
- Yi 4k light python API☆16May 21, 2017Updated 9 years ago
- ESP8266 based weather monitor with 128x32 oled display☆13Apr 15, 2019Updated 7 years ago
- ☆12Jun 22, 2015Updated 11 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Docker configuration for koboldcpp☆44Mar 27, 2024Updated 2 years ago
- A custom, configurable drag-and-drop smart display system☆22Updated this week
- Beautiful Reddit threads, live in your terminal☆110Jun 17, 2026Updated 3 weeks ago
- Created Francisco Angulo de Lafuente ⚡️Deploy the DEMO⬇️☆30May 8, 2026Updated 2 months ago
- Displays current weather conditions inside and out☆12Aug 3, 2015Updated 10 years ago
- 6 kB init.lua for NodeMCU to install lua files via wifi☆13May 5, 2015Updated 11 years ago
- Embed, cluster, and visualize any collection of texts in 3D semantic space — then learn a continuous semantic flow field over that space,…☆18May 9, 2026Updated 2 months ago