Dynamic LLM model swapping system with Docker, vLLM integration, and GPU acceleration. Supports GGUF & Hugging Face models with automatic swapping and Traefik routing.
☆23Mar 6, 2026Updated 5 months ago
Alternatives and similar repositories for llama-swap-vllm-boilerplate
Users that are interested in llama-swap-vllm-boilerplate are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- nostr paid relay, but with monero decentralized, monero, nostr, relay, strfry, xmr☆32May 15, 2025Updated last year
- Docker/podman container for llama.cpp/vllm/exllamav{2,3} orchestrated using llama-swap☆18Jun 17, 2026Updated 2 months ago
- A zero-allocation, header-only C++ BPE tokenizer for Qwen, built for maximum inference throughput.☆23Apr 3, 2026Updated 4 months ago
- Wrapper for the kraken OCR engine☆12Jul 12, 2025Updated last year
- A repository to store helpful information and emerging insights in regard to LLMs☆21Oct 27, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- This is the official repository of the EMNLP 2023 paper Reading Order Matters: Information Extraction from Visually-rich Documents by Tok…☆18Mar 15, 2024Updated 2 years ago
- MoFlo — an opinionated, local-first AI agent orchestration toolkit for Claude Code: semantic memory, learned routing, gates, and spells. …☆18Updated this week
- PXQ: PXA-native low-bit MoE quants (2/3/4-bit, E16-row scales) + fused CUDA kernels for Pascal/Volta — run a real 35B on a salvaged 12-16…☆16Updated this week
- Chatbot-to-speech using Orpheus TTS model. Interactive console app.☆21May 1, 2025Updated last year
- Yet another frontend for LLM, written using .NET and WinUI 3☆11Sep 14, 2025Updated 11 months ago
- Fast LLM swapping with sleep/wake support, compatible with vllm, llama.cpp, etc. llama-swap fork.☆53Apr 5, 2026Updated 4 months ago
- ☆24Dec 8, 2022Updated 3 years ago
- Fork of github.com/UCSBarchlab/OpenTPU for the TGPTPU project☆15Jun 1, 2025Updated last year
- Using CogVLM and CogAgent for image captioning☆15Dec 29, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Plan and train German transformer models.☆23Feb 22, 2021Updated 5 years ago
- NeoJS is a JavaScript scriptable NeoPixel LED Controller with an easy to use Web UI☆15May 1, 2024Updated 2 years ago
- A dynamic multi-expert AI architecture running on a single consumer GPU (RTX 3060).☆36Dec 2, 2025Updated 8 months ago
- A tag editor written in C# and WPF☆12Aug 20, 2023Updated 3 years ago
- Simple Tool Caller for llama.cpp☆11Aug 12, 2024Updated 2 years ago
- Notify 9 Axis IMU data from M5Stack-Gray with BLE☆13Jun 9, 2019Updated 7 years ago
- Bluetooth LE Keyboard & Mouse & Gamepad, compatible with Arduino Keyboard, Mouse and Gamepad☆12Dec 13, 2022Updated 3 years ago
- Stop prompting your agents to behave. Start engineering them to.☆26Apr 17, 2026Updated 4 months ago
- Windows GUI for install apks☆12Nov 18, 2018Updated 7 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- M5STACK Arduino WiFi Photo Backup device☆15Feb 25, 2018Updated 8 years ago
- PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation☆33Nov 16, 2024Updated last year
- ☆14Oct 31, 2023Updated 2 years ago
- Docker configuration for koboldcpp☆45Mar 27, 2024Updated 2 years ago
- Workaround To Disabling Head-Tracking On A Unity OpenVR Camera.☆18Jul 9, 2017Updated 9 years ago
- O framework seguro e leve de código aberto para agentes de IA desenvolvido 100% em português.☆16Updated this week
- ☆13Apr 24, 2024Updated 2 years ago
- Pure Javascript Toast Alert Message☆19Feb 21, 2022Updated 4 years ago
- Create text chunks which end at natural stopping points without using a tokenizer☆26Nov 26, 2025Updated 8 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Arduino library for controlling Sonos system with wemos.cc or other ESP8266-based board☆15Apr 12, 2026Updated 4 months ago
- Conformer block with Rotary Position Embedding, modified from lucidrains' implement☆19Sep 13, 2024Updated last year
- MCP server and CLI tool that gives AI agents access to YouTube☆29Aug 10, 2026Updated last week
- Implement spike-drive using OR residual connection and propose SynA attention for natural pruning.(Under Review)☆13Mar 31, 2024Updated 2 years ago
- Synthèses vocale piper oobabooga☆14Feb 24, 2024Updated 2 years ago
- Script Execution service☆13Nov 21, 2016Updated 9 years ago
- A high performance batching router optimises max throughput for text inference workload☆16Sep 6, 2023Updated 2 years ago