Dynamic LLM model swapping system with Docker, vLLM integration, and GPU acceleration. Supports GGUF & Hugging Face models with automatic swapping and Traefik routing.
☆23Mar 6, 2026Updated 6 months ago
Alternatives and similar repositories for llama-swap-vllm-boilerplate
Users that are interested in llama-swap-vllm-boilerplate are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Docker/podman container for llama.cpp/vllm/exllamav{2,3} orchestrated using llama-swap☆18Jun 17, 2026Updated 2 months ago
- A zero-allocation, header-only C++ BPE tokenizer for Qwen, built for maximum inference throughput.☆23Apr 3, 2026Updated 5 months ago
- A repository to store helpful information and emerging insights in regard to LLMs☆21Oct 27, 2023Updated 2 years ago
- 🤵 AIfred-Intelligence — self-hosted Multi-Agent Assistant with Debate Modes (Symposion/Tribunal), Voice (STT + Streaming-TTS), RAG with …☆37Updated this week
- This is the official repository of the EMNLP 2023 paper Reading Order Matters: Information Extraction from Visually-rich Documents by Tok…☆18Mar 15, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- MoFlo — an opinionated, local-first AI agent orchestration toolkit for Claude Code: semantic memory, learned routing, gates, and spells. …☆18Updated this week
- Chatbot-to-speech using Orpheus TTS model. Interactive console app.☆21May 1, 2025Updated last year
- Yet another frontend for LLM, written using .NET and WinUI 3☆11Sep 14, 2025Updated 11 months ago
- Fast LLM swapping with sleep/wake support, compatible with vllm, llama.cpp, etc. llama-swap fork.☆56Apr 5, 2026Updated 5 months ago
- Module python de normalisation de libellés de voie/lieu-dit☆10Feb 12, 2022Updated 4 years ago
- Fork of github.com/UCSBarchlab/OpenTPU for the TGPTPU project☆15Jun 1, 2025Updated last year
- Using CogVLM and CogAgent for image captioning☆15Dec 29, 2023Updated 2 years ago
- A VR180 photo viewer that works on a web browser.☆12May 18, 2019Updated 7 years ago
- Physical Cube using ESP32, Acc+Gyro and Bluetooth LE displayed in a Browser - A WebBluetooth experiment☆12Mar 30, 2018Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- NeoJS is a JavaScript scriptable NeoPixel LED Controller with an easy to use Web UI☆15May 1, 2024Updated 2 years ago
- A tag editor written in C# and WPF☆12Aug 20, 2023Updated 3 years ago
- Simple Tool Caller for llama.cpp☆11Aug 12, 2024Updated 2 years ago
- Simple stereo viewer for .MPO photos.☆12Feb 6, 2025Updated last year
- Notify 9 Axis IMU data from M5Stack-Gray with BLE☆13Jun 9, 2019Updated 7 years ago
- Bluetooth LE Keyboard & Mouse & Gamepad, compatible with Arduino Keyboard, Mouse and Gamepad☆12Dec 13, 2022Updated 3 years ago
- Stop prompting your agents to behave. Start engineering them to.☆26Apr 17, 2026Updated 4 months ago
- M5STACK Arduino WiFi Photo Backup device☆15Feb 25, 2018Updated 8 years ago
- PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation☆33Nov 16, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆14Oct 31, 2023Updated 2 years ago
- A Streamlit app to upload files and query with DuckDB☆15Jan 18, 2024Updated 2 years ago
- Portable version of the Pentaho Data Integration (Kettle) application, for Windows☆13Jun 7, 2024Updated 2 years ago
- Docker configuration for koboldcpp☆46Mar 27, 2024Updated 2 years ago
- Create text chunks which end at natural stopping points without using a tokenizer☆26Nov 26, 2025Updated 9 months ago
- Arduino library for controlling Sonos system with wemos.cc or other ESP8266-based board☆15Apr 12, 2026Updated 5 months ago
- Synthèses vocale piper oobabooga☆14Feb 24, 2024Updated 2 years ago
- Beautiful Reddit threads, live in your terminal☆146Jun 17, 2026Updated 2 months ago
- ESP8266 HTU21D SSD1306☆15Jun 8, 2015Updated 11 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A high performance batching router optimises max throughput for text inference workload☆16Sep 6, 2023Updated 3 years ago
- 🍨 Gelato — From Data Curation to Reinforcement Learning: Building a Strong Grounding Model for Computer-Use Agents☆46Dec 22, 2025Updated 8 months ago
- ☆24Apr 25, 2025Updated last year
- 249M-param MoE transformer built from scratch in PyTorch. GQA, RoPE, SwiGLU, sparse MoE with 3 aux losses, AMP training loop no Trainer a…☆19May 22, 2026Updated 3 months ago
- LigthPainting on an ESP8266 via wifi☆19Oct 15, 2023Updated 2 years ago
- Generate a wiki for your research topic, sourcing from the web and your docs.☆58Mar 8, 2025Updated last year
- temperature - pressure - humidity - mqtt sensor☆18Oct 10, 2017Updated 8 years ago