Dynamic LLM model swapping system with Docker, vLLM integration, and GPU acceleration. Supports GGUF & Hugging Face models with automatic swapping and Traefik routing.
☆22Mar 6, 2026Updated 4 months ago
Alternatives and similar repositories for llama-swap-vllm-boilerplate
Users that are interested in llama-swap-vllm-boilerplate are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- nostr paid relay, but with monero decentralized, monero, nostr, relay, strfry, xmr☆33May 15, 2025Updated last year
- Docker/podman container for llama.cpp/vllm/exllamav{2,3} orchestrated using llama-swap☆18Jun 17, 2026Updated last month
- Wrapper for the kraken OCR engine☆12Jul 12, 2025Updated last year
- 🤵 AIfred-Intelligence — self-hosted Multi-Agent Assistant with Debate Modes (Symposion/Tribunal), Voice (STT + Streaming-TTS), RAG with …☆33Updated this week
- A repository to store helpful information and emerging insights in regard to LLMs☆21Oct 27, 2023Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- This is the official repository of the EMNLP 2023 paper Reading Order Matters: Information Extraction from Visually-rich Documents by Tok…☆18Mar 15, 2024Updated 2 years ago
- TeamCopilot: Deploy AI agents for your team to automate business workflows and coding.☆15Jun 23, 2026Updated last month
- OCR post correction for old German corpus☆20Aug 29, 2022Updated 3 years ago
- MoFlo — an opinionated, local-first AI agent orchestration toolkit for Claude Code: semantic memory, learned routing, gates, and spells. …☆16Updated this week
- A simple, observable code-writing agent builder in TypeScript.☆33Apr 9, 2025Updated last year
- Chatbot-to-speech using Orpheus TTS model. Interactive console app.☆21May 1, 2025Updated last year
- Yet another frontend for LLM, written using .NET and WinUI 3☆11Sep 14, 2025Updated 10 months ago
- Fast LLM swapping with sleep/wake support, compatible with vllm, llama.cpp, etc. llama-swap fork.☆51Apr 5, 2026Updated 3 months ago
- ☆24Dec 8, 2022Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Fork of github.com/UCSBarchlab/OpenTPU for the TGPTPU project☆15Jun 1, 2025Updated last year
- A VR180 photo viewer that works on a web browser.☆12May 18, 2019Updated 7 years ago
- Plan and train German transformer models.☆23Feb 22, 2021Updated 5 years ago
- Physical Cube using ESP32, Acc+Gyro and Bluetooth LE displayed in a Browser - A WebBluetooth experiment☆12Mar 30, 2018Updated 8 years ago
- A dynamic multi-expert AI architecture running on a single consumer GPU (RTX 3060).☆36Dec 2, 2025Updated 8 months ago
- A tag editor written in C# and WPF☆12Aug 20, 2023Updated 2 years ago
- Simple stereo viewer for .MPO photos.☆12Feb 6, 2025Updated last year
- Bluetooth LE Keyboard & Mouse & Gamepad, compatible with Arduino Keyboard, Mouse and Gamepad☆12Dec 13, 2022Updated 3 years ago
- Stop prompting your agents to behave. Start engineering them to.☆25Apr 17, 2026Updated 3 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Windows GUI for install apks☆12Nov 18, 2018Updated 7 years ago
- PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation☆32Nov 16, 2024Updated last year
- ☆14Oct 31, 2023Updated 2 years ago
- ☆12Jun 22, 2015Updated 11 years ago
- Yi 4k light python API☆16May 21, 2017Updated 9 years ago
- ESP8266 based weather monitor with 128x32 oled display☆13Apr 15, 2019Updated 7 years ago
- Portable version of the Pentaho Data Integration (Kettle) application, for Windows☆13Jun 7, 2024Updated 2 years ago
- Docker configuration for koboldcpp☆45Mar 27, 2024Updated 2 years ago
- O framework seguro e leve de código aberto para agentes de IA desenvolvido 100% em português.☆15Jul 28, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Displays current weather conditions inside and out☆12Aug 3, 2015Updated 11 years ago
- ☆13Apr 24, 2024Updated 2 years ago
- Create text chunks which end at natural stopping points without using a tokenizer☆26Nov 26, 2025Updated 8 months ago
- Symfony bundle to fetch data from LaPoste DataNOVA (Open Data API)☆15Apr 19, 2020Updated 6 years ago
- Conformer block with Rotary Position Embedding, modified from lucidrains' implement☆19Sep 13, 2024Updated last year
- An efficient spiking variational autoencoder☆13Nov 13, 2023Updated 2 years ago
- MCP server and CLI tool that gives AI agents access to YouTube☆27May 23, 2026Updated 2 months ago