Fast LLM swapping with sleep/wake support, compatible with vllm, llama.cpp, etc. llama-swap fork.
☆58Apr 5, 2026Updated 7 months ago
Alternatives and similar repositories for llmsnap
Users that are interested in llmsnap are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Dynamic LLM model swapping system with Docker, vLLM integration, and GPU acceleration. Supports GGUF & Hugging Face models with automatic…☆23Mar 6, 2026Updated 8 months ago
- Give GeForce cards (Turing and later) a BAR1 at least as large as their VRAM on Linux, without flashing.☆23Nov 6, 2026Updated last week
- The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.☆10Jul 7, 2026Updated 4 months ago
- AI mobile automation starter repo for AIVane. Android REPL beta, Python client, skills, examples, and protocol docs for AI agents.☆14Sep 9, 2026Updated 2 months ago
- Generate Your Own Private Morning Radio for Commute☆33Feb 5, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Python SDK for Agent Vector Protocol – transfer KV-cache between LLM agents instead of text☆30Apr 26, 2026Updated 6 months ago
- Proxy for Looking Glass over local networks☆28May 13, 2024Updated 2 years ago
- Three inference engines for Llama 3: pure C for desktop systems, pure JavaScript for Node.js, and pure JavaScript for Web environments. S…☆26Oct 30, 2026Updated last week
- Various scripts for configuring and administering a Proxmox (Debian) server and VMs☆49Jan 3, 2021Updated 5 years ago
- llama-swap + a minimal ollama compatible api☆63Sep 29, 2026Updated last month
- SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere sm_86, 2× A5000/3090). Qwen3.6-35…☆133Sep 30, 2026Updated last month
- A proxy that hosts multiple single-model runners such as LLama.cpp and vLLM☆12May 30, 2025Updated last year
- Static analysis toolkit for LLM agent plans☆13Aug 9, 2025Updated last year
- Multi-GPU device selection for LTXV2 video generation in ComfyUI☆34Jan 10, 2026Updated 10 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A simple, observable code-writing agent builder in TypeScript.☆34Apr 9, 2025Updated last year
- Scripts and tools for optimizing quantizations in llama.cpp with GGUF imatrices.☆19Oct 19, 2026Updated 3 weeks ago
- Repo for YouTube tutorial on how to self-host a MinIo instance and connect a Next.js 15 app to MinIo and upload files☆21Jan 15, 2025Updated last year
- Testbench for llama.cpp llama-server☆15Aug 20, 2025Updated last year
- Unlock P2P comms between consumer NVIDIA GPUs☆719Oct 26, 2026Updated 2 weeks ago
- FlashAttention brought back to Tesla V100 — a deep llama.cpp fork: SM 7.0 D256 kernels, SplitKV3, q4_0 KV cache, DFlash2 speculative deco…☆19Updated this week
- Since the owner of the repo took it down and it used an MIT license, I guess it's okay to upload it here for people to use.☆54Mar 11, 2025Updated last year
- 🔥 Alternative to Ollama — multi-model serving with sub-ms model switching · CPU-only 20B inference for Edge AI · llama.cpp + stablediffu…☆43Sep 27, 2026Updated last month
- Implements harmful/harmless refusal removal using pure HF Transformers☆25May 8, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆14Jul 2, 2025Updated last year
- A practical, hands-on guide to building a small language model from scratch. Learn transformer architecture, attention mechanisms, and tr…☆26Dec 10, 2025Updated 11 months ago
- Crawl4AI skill for OpenClaw - Web crawling with login support for Twitter/X and Xiaohongshu☆17Mar 11, 2026Updated 8 months ago
- ☆12Jun 2, 2025Updated last year
- ☆15Mar 18, 2026Updated 7 months ago
- ☆18Jul 1, 2025Updated last year
- ☆12Jan 4, 2026Updated 10 months ago
- Make Qwen3 Think like Gemini 2.5 Pro | Open webui function☆24May 10, 2025Updated last year
- Install micromamba, and optionally create a base conda environment.☆10Apr 5, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Simple node proxy for llama-server that enables MCP use☆19May 10, 2025Updated last year
- Zoof is a high-efficiency Small Language Model (SLM) engineered from scratch. It demonstrates how modern architectural choices and high-q…☆48Jan 13, 2026Updated 9 months ago
- A zero-allocation, header-only C++ BPE tokenizer for Qwen, built for maximum inference throughput.☆24Apr 3, 2026Updated 7 months ago
- Some of my tools for paperless-ngx, for example title generation☆11Jul 10, 2024Updated 2 years ago
- An open-source AI agent that lives in your terminal, privacy oriented, with no telemetry.☆90Updated this week
- PCIe P2P on consumer RTX 5090 via one GSP firmware registry key — no driver patches.☆25Apr 17, 2026Updated 6 months ago
- A web application that converts speech to speech 100% private☆87Jun 3, 2025Updated last year
Are these results useful?