30 tok/s for 20B MoE on 8 GB VRAM. Flat throughput to 32K context. Native MXFP4 + GGUF Q4_K/Q5_K/Q6_K via ggml CUDA kernels — zero dequant. Expert offloading for models that don't fit in GPU memory.
☆23Apr 7, 2026Updated 6 months ago
Alternatives and similar repositories for tinyserve
Users that are interested in tinyserve are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆21Mar 15, 2025Updated last year
- Self-hosting ChatGPT/Codex Plugin autopilot — copy-in, repo-owned. Converts agentic repos into validated, deterministically packaged Plug…☆78Sep 10, 2026Updated last month
- WINGS is an open-source, simple golang-based platform for front-end web application development.☆29Aug 4, 2026Updated 2 months ago
- A Model Context Protocol (MCP) server which allows MCP Clients (such as Claude) to connect to Twitch Chat.☆12Jan 20, 2025Updated last year
- Go program to launch and configure LXD containers and attached disk devices☆12Nov 22, 2023Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- pr triage ui☆15Oct 3, 2026Updated 2 weeks ago
- High-fidelity transcript memory for Claude Code — index every session, recall byte-identical, search, prune, compose. Local-first, stdlib…☆18Aug 10, 2026Updated 2 months ago
- 27B at 256k context on one RTX 5090 — FP6 + 4-bit KV + MTP spec-decode, hand-written SM120 tensor-core kernels, OpenAI API.☆18Aug 18, 2026Updated 2 months ago
- My personal Navidrome SmartPlaylist collection.☆14Updated this week
- 🌌 The Plasm programming language compiler☆25Updated this week
- GSD Loop - Spec/Build/Review - A Skill to keep your agent on a loop task until completion☆24Sep 9, 2026Updated last month
- Romance Meter Extension for SillyTavern☆16Aug 4, 2025Updated last year
- My wezterm config☆17Feb 18, 2023Updated 3 years ago
- ☆14Apr 16, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆15Feb 10, 2026Updated 8 months ago
- ☆15Oct 20, 2024Updated 2 years ago
- ☆18Jun 17, 2025Updated last year
- A collection of LittleSnitch rule sets to block outbound connections to a given country.☆16Jun 13, 2023Updated 3 years ago
- Giant MoE models on a single consumer GPU by streaming experts from SSD. CUDA fork of antirez/ds4: runs GLM-5.2 (743B), Tencent Hy3 (295B…☆40Jul 12, 2026Updated 3 months ago
- A fruit fly connectome (165k neurons, 25.6M synapses) trained to drive a simulated street from pixels. Code, patches, renderer, results.☆33Sep 13, 2026Updated last month
- The open source coding agent.☆19Oct 1, 2026Updated 3 weeks ago
- A fork of https://github.com/Niko1221/Strata optimized for my 3090+5070 Ti setup, see docs/COMPARISON.md. Renamed to StrataFast.☆49Updated this week
- Offline AI music recommender & recogniser. Local song ID + smart playlists (CLAP + FAISS).☆16Aug 14, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Production-grade Skill orchestration, SOP enforcement, and long-context runtime control for OpenCode☆18Mar 29, 2026Updated 6 months ago
- ☆18Oct 27, 2025Updated 11 months ago
- Effortlessly deploy a hardware-passthrough (VFIO) setup for Virtual Machines (VMs) on a Linux desktop. Includes quality-of-life features …☆18Apr 3, 2025Updated last year
- GPT with metaweights: weights that don't actually exist☆25Oct 4, 2026Updated 2 weeks ago
- 100% Free & Open Source • Privacy-First Security Scanning and AI Code Review CLI☆16Updated this week
- HIP/ROCm fork optimized for AMD RDNA2 (gfx1030) with PrismML Q1_0_G128 1-bit quant support, RotorQuant, TurboQuant, EAGLE3 and P-EAGLE sp…☆26Jun 23, 2026Updated 4 months ago
- OLX MCP server. 100% vibe-coded AI slop☆26Aug 26, 2026Updated last month
- A specialized Model Context Protocol (MCP) server for full-text search within a filesystem.☆22Apr 8, 2025Updated last year
- ☆17Mar 10, 2026Updated 7 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 🐼 Born of panda. Awakened as Anda. A copilot for your computer, powered by the Anda Brain.☆26Oct 17, 2026Updated last week
- My Incus playground☆22Oct 12, 2026Updated last week
- 𝐀 𝐅𝐨𝐫𝐤 𝐨𝐟 𝐂𝐡𝐢𝐜𝐚𝐠𝐨𝟗𝟓 𝐦𝐚𝐝𝐞 𝐭𝐨 𝐥𝐨𝐨𝐤 𝐥𝐢𝐤𝐞 𝐖𝐢𝐧𝐝𝐨𝐰𝐬 𝟐𝟎𝟎𝟎.☆22Sep 1, 2026Updated last month
- Portable C++17 implementation of YuE2 AI Music Generator using GGML. Text + lyrics in, stereo 48kHz MP3 or WAV out. Runs on CPU, CUDA, RO…☆44Oct 16, 2026Updated last week
- Run autoresearch on any NVIDIA GPUs (Works on 2-4GB+ Cards)☆27Mar 22, 2026Updated 7 months ago
- 0DTE options research for Interactive Brokers — Python scripts to develop, backtest and validate zero-days-to-expiration setups.☆17Aug 11, 2026Updated 2 months ago
- Generate random nonsense phrases from words in a file☆21Dec 27, 2025Updated 9 months ago