Dynamic LLM model swapping system with Docker, vLLM integration, and GPU acceleration. Supports GGUF & Hugging Face models with automatic swapping and Traefik routing.
☆23Mar 6, 2026Updated 6 months ago
Alternatives and similar repositories for llama-swap-vllm-boilerplate
Users that are interested in llama-swap-vllm-boilerplate are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- nostr paid relay, but with monero decentralized, monero, nostr, relay, strfry, xmr☆30May 15, 2025Updated last year
- A zero-allocation, header-only C++ BPE tokenizer for Qwen, built for maximum inference throughput.☆24Apr 3, 2026Updated 5 months ago
- MoFlo — an opinionated, local-first AI agent orchestration toolkit for Claude Code: semantic memory, learned routing, gates, and spells. …☆18Updated this week
- A simple, observable code-writing agent builder in TypeScript.☆33Apr 9, 2025Updated last year
- Chatbot-to-speech using Orpheus TTS model. Interactive console app.☆21May 1, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Yet another frontend for LLM, written using .NET and WinUI 3☆11Sep 14, 2025Updated last year
- Fast LLM swapping with sleep/wake support, compatible with vllm, llama.cpp, etc. llama-swap fork.☆57Apr 5, 2026Updated 5 months ago
- Superseded by github.com/poisonxa16/pxa — PXA, the set-and-forget engine for Pascal and Volta☆24Sep 8, 2026Updated 3 weeks ago
- Module python de normalisation de libellés de voie/lieu-dit☆10Feb 12, 2022Updated 4 years ago
- Fork of github.com/UCSBarchlab/OpenTPU for the TGPTPU project☆14Jun 1, 2025Updated last year
- Using CogVLM and CogAgent for image captioning☆15Dec 29, 2023Updated 2 years ago
- A VR180 photo viewer that works on a web browser.☆12May 18, 2019Updated 7 years ago
- Simple Tool Caller for llama.cpp☆11Aug 12, 2024Updated 2 years ago
- Simple stereo viewer for .MPO photos.☆12Feb 6, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Notify 9 Axis IMU data from M5Stack-Gray with BLE☆13Jun 9, 2019Updated 7 years ago
- Stop prompting your agents to behave. Start engineering them to.☆26Apr 17, 2026Updated 5 months ago
- PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation☆33Nov 16, 2024Updated last year
- ☆14Oct 31, 2023Updated 2 years ago
- ☆12Jun 22, 2015Updated 11 years ago
- ESP8266 based weather monitor with 128x32 oled display☆13Apr 15, 2019Updated 7 years ago
- Docker configuration for koboldcpp☆45Mar 27, 2024Updated 2 years ago
- Displays current weather conditions inside and out☆12Aug 3, 2015Updated 11 years ago
- Pure Javascript Toast Alert Message☆19Feb 21, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 6 kB init.lua for NodeMCU to install lua files via wifi☆13May 5, 2015Updated 11 years ago
- Create text chunks which end at natural stopping points without using a tokenizer☆26Nov 26, 2025Updated 10 months ago
- Conformer block with Rotary Position Embedding, modified from lucidrains' implement☆19Sep 13, 2024Updated 2 years ago
- An efficient spiking variational autoencoder☆13Nov 13, 2023Updated 2 years ago
- 🟢 NVIDIA ONLY – All-in-One TTS App with Kokoro, KittenTTS, Higgs audio, Chatterbox, Fish-Speech, F5 & index-tts & indextts2, Supports Co…☆31Feb 18, 2026Updated 7 months ago
- Synthèses vocale piper oobabooga☆14Feb 24, 2024Updated 2 years ago
- Script Execution service☆13Nov 21, 2016Updated 9 years ago
- Beautiful Reddit threads, live in your terminal☆146Jun 17, 2026Updated 3 months ago
- A high performance batching router optimises max throughput for text inference workload☆16Sep 6, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Adaptive Reasoning Engine for Efficient and Context-Aware Intelligence☆50Nov 15, 2025Updated 10 months ago
- 249M-param MoE transformer built from scratch in PyTorch. GQA, RoPE, SwiGLU, sparse MoE with 3 aux losses, AMP training loop no Trainer a…☆19May 22, 2026Updated 4 months ago
- Generate a wiki for your research topic, sourcing from the web and your docs.☆58Mar 8, 2025Updated last year
- Sipeed Tang Nano: Fully Opensource Toolchain for FPGA Synthesis, Place & Route, Simulation and Download/Flash.☆17Jul 26, 2024Updated 2 years ago
- This is an LLM interface that you can use to analyze and get insight into diary entries or other documents completely offline.☆16Dec 31, 2023Updated 2 years ago
- Ultra-low-latency LLM gateway with microsecond caching, dynamic routing, budgets, analytics, and forecasting.☆17Apr 2, 2026Updated 6 months ago
- A custom, configurable drag-and-drop smart display system☆59Updated this week