30 tok/s for 20B MoE on 8 GB VRAM. Flat throughput to 32K context. Native MXFP4 + GGUF Q4_K/Q5_K/Q6_K via ggml CUDA kernels — zero dequant. Expert offloading for models that don't fit in GPU memory.
☆21Apr 7, 2026Updated 4 months ago
Alternatives and similar repositories for tinyserve
Users that are interested in tinyserve are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Scripts and Ansible playbook to setup Arch Linux on ZFS.☆12Jun 16, 2024Updated 2 years ago
- Effortlessly deploy a hardware-passthrough (VFIO) setup for Virtual Machines (VMs) on a Linux desktop. Includes quality-of-life features …☆18Apr 3, 2025Updated last year
- Frequency-based KV cache pruning for llama.cpp — 25% cache reduction, improved PPL at long context. GPU compaction kernel for HIP/ROCm.☆16Apr 18, 2026Updated 4 months ago
- Production-grade Skill orchestration, SOP enforcement, and long-context runtime control for OpenCode☆18Mar 29, 2026Updated 4 months ago
- My Incus playground☆21Jun 27, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Telegram bot which can work with both openAI and LocalAI modes, it also uses UncensoredGPT models like Wizard-Uncensored. It can be launc…☆21Mar 14, 2025Updated last year
- World's first TurboQuant KV cache compression for llama.cpp on AMD ROCm (RX 9070 / gfx1201)☆19Apr 28, 2026Updated 3 months ago
- The ultimate Meta-Prompt for Agentic Coding (Cursor, Windsurf, Cline). Synthesized from 1.5MB of top global system prompts analyzed by Ge…☆15Mar 17, 2026Updated 5 months ago
- Session manager for Claude Code with automatic documentation and artifact tracking☆33Updated this week
- Local drive deep search.☆35Jun 4, 2025Updated last year
- EWDK C++ toolchain for bazel☆12Updated this week
- LLM Chat is an open-source serverless alternative to ChatGPT.☆36Sep 13, 2024Updated last year
- A command-line tool that combines multiple AI models (Claude, OpenAI, Gemini) to generate comprehensive architectural plans☆71May 22, 2025Updated last year
- Actively maintained Python client for the Robinhood API, and a migration path off robin_stocks. Keeps scheduled scripts alive: sessions r…☆18Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- This repository is a mirror of https://git.openwrt.org/openwrt/openwrt.git It is for reference only and is not active for check-ins. We …☆17Updated this week
- A set of scripts to build a docker environment that easily runs QEMU/Libvirt, and includes looking-glass + scream for sound. Supports VFI…☆30Nov 6, 2022Updated 3 years ago
- L'application pour bloquer un paquet, snipping, analyser le réseau☆11Dec 23, 2016Updated 9 years ago
- ☆10Aug 16, 2019Updated 7 years ago
- ☆12May 17, 2020Updated 6 years ago
- Flow - Modern C++ toolkit for async loops, logs, config, benchmarking, and more [See also `ipc` repo]☆14Updated this week
- Self-Loading Registration Free COM Functions☆11Nov 12, 2019Updated 6 years ago
- 4 distros, one USB, ZFS on root. Debian, Fedora, RHEL and Arch. Offline install, boot environments, WireGuard, eBPF. Free.☆39Updated this week
- ☆11Jan 8, 2022Updated 4 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- 一个开放源码的Windows视频播放器☆10May 9, 2021Updated 5 years ago
- PhysPatch performs physical memory scanning and patching of the entire Windows Kernel using DMA☆13Nov 10, 2024Updated last year
- Can convert any binary data into an Obj with vertices, useful for reverse-engineering.☆11Mar 27, 2026Updated 4 months ago
- A REALLY Danger Windows Driver, Turn Any threads Ring0!☆13Jul 20, 2026Updated last month
- Test data for x86 instructions☆13Apr 13, 2021Updated 5 years ago
- break link between dll and it file on disk☆12Sep 2, 2024Updated last year
- Scripts and Ansible playbook to setup Void Linux on ZFS.☆35Jun 11, 2026Updated 2 months ago
- Copilot with deepseek and more...☆13Mar 7, 2025Updated last year
- ☆10May 28, 2026Updated 2 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Code Coverage client for DynamoRIO☆12Jan 20, 2019Updated 7 years ago
- eject_idb is a last ditch effort to flush and save your IDB when IDA hangs or a plugin causes an exception, etc.☆42Updated this week
- A repo that explain how to install Arch Linux featuring encryption, Secure Boot, btrfs and AppArmor.☆38May 17, 2022Updated 4 years ago
- RISC-V to x86/64 instruction emulator written in C/C++☆11Jan 10, 2022Updated 4 years ago
- Automatically exported from code.google.com/p/windbgshark☆12Nov 3, 2015Updated 10 years ago
- Clipboard Regex Replace is a lightweight GoLang application that allows you to automatically apply regex-based replacements to your clipb…☆10Jan 20, 2026Updated 7 months ago
- netease python2 inject hook☆13Jan 8, 2025Updated last year