30 tok/s for 20B MoE on 8 GB VRAM. Flat throughput to 32K context. Native MXFP4 + GGUF Q4_K/Q5_K/Q6_K via ggml CUDA kernels — zero dequant. Expert offloading for models that don't fit in GPU memory.
☆19Apr 7, 2026Updated 3 months ago
Alternatives and similar repositories for tinyserve
Users that are interested in tinyserve are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A collection of LittleSnitch rule sets to block outbound connections to a given country.☆16Jun 13, 2023Updated 3 years ago
- Effortlessly deploy a hardware-passthrough (VFIO) setup for Virtual Machines (VMs) on a Linux desktop. Includes quality-of-life features …☆18Apr 3, 2025Updated last year
- Frequency-based KV cache pruning for llama.cpp — 25% cache reduction, improved PPL at long context. GPU compaction kernel for HIP/ROCm.☆16Apr 18, 2026Updated 3 months ago
- Production-grade Skill orchestration, SOP enforcement, and long-context runtime control for OpenCode☆18Mar 29, 2026Updated 4 months ago
- An alternative to Arc Control by Intel®.☆18Jun 16, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- My Incus playground☆21Jun 27, 2026Updated last month
- An Arch Linux AUR helper, aurutils wrapper script that sets up aurutils in an nspawn container.☆29Jul 25, 2026Updated last week
- Telegram bot which can work with both openAI and LocalAI modes, it also uses UncensoredGPT models like Wizard-Uncensored. It can be launc…☆23Mar 14, 2025Updated last year
- World's first TurboQuant KV cache compression for llama.cpp on AMD ROCm (RX 9070 / gfx1201)☆18Apr 28, 2026Updated 3 months ago
- Local drive deep search.☆35Jun 4, 2025Updated last year
- EWDK C++ toolchain for bazel☆12Jul 13, 2026Updated 3 weeks ago
- A command-line tool that combines multiple AI models (Claude, OpenAI, Gemini) to generate comprehensive architectural plans☆71May 22, 2025Updated last year
- Automatically synchronize your dotfiles to git in the background☆22Feb 1, 2024Updated 2 years ago
- This repository is a mirror of https://git.openwrt.org/openwrt/openwrt.git It is for reference only and is not active for check-ins. We …☆17Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A set of scripts to build a docker environment that easily runs QEMU/Libvirt, and includes looking-glass + scream for sound. Supports VFI…☆30Nov 6, 2022Updated 3 years ago
- L'application pour bloquer un paquet, snipping, analyser le réseau☆11Dec 23, 2016Updated 9 years ago
- Tool for obtaining information about PPL processes☆16Feb 12, 2024Updated 2 years ago
- ☆10Aug 16, 2019Updated 6 years ago
- ☆12May 17, 2020Updated 6 years ago
- Flow - Modern C++ toolkit for async loops, logs, config, benchmarking, and more [See also `ipc` repo]☆14Jun 24, 2026Updated last month
- ☆11Jan 8, 2022Updated 4 years ago
- Windows file system driver which allows to block access to files at run-time (C/C++, C#, WDK, SDK)☆12Jan 1, 2023Updated 3 years ago
- Panda - is a set of utilities used to research how PsExec encrypts its traffic.☆13Apr 20, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 一个开放源码的Windows视频播放器☆10May 9, 2021Updated 5 years ago
- PhysPatch performs physical memory scanning and patching of the entire Windows Kernel using DMA☆13Nov 10, 2024Updated last year
- ☆28Oct 9, 2024Updated last year
- Can convert any binary data into an Obj with vertices, useful for reverse-engineering.☆11Mar 27, 2026Updated 4 months ago
- A helper library for working with Plutus blueprints (Aiken or Plutarch)☆19Mar 23, 2026Updated 4 months ago
- A REALLY Danger Windows Driver, Turn Any threads Ring0!☆13Jul 20, 2026Updated 2 weeks ago
- Test data for x86 instructions☆13Apr 13, 2021Updated 5 years ago
- Scripts and Ansible playbook to setup Void Linux on ZFS.☆35Jun 11, 2026Updated last month
- Copilot with deepseek and more...☆13Mar 7, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆10May 28, 2026Updated 2 months ago
- The Windows driver and device management program for NDAS devices such as the NetDISK.☆16Jun 17, 2016Updated 10 years ago
- Code Coverage client for DynamoRIO☆12Jan 20, 2019Updated 7 years ago
- A repo that explain how to install Arch Linux featuring encryption, Secure Boot, btrfs and AppArmor.☆38May 17, 2022Updated 4 years ago
- RISC-V to x86/64 instruction emulator written in C/C++☆11Jan 10, 2022Updated 4 years ago
- Automatically exported from code.google.com/p/windbgshark☆12Nov 3, 2015Updated 10 years ago
- Clipboard Regex Replace is a lightweight GoLang application that allows you to automatically apply regex-based replacements to your clipb…☆10Jan 20, 2026Updated 6 months ago