30 tok/s for 20B MoE on 8 GB VRAM. Flat throughput to 32K context. Native MXFP4 + GGUF Q4_K/Q5_K/Q6_K via ggml CUDA kernels — zero dequant. Expert offloading for models that don't fit in GPU memory.
☆22Apr 7, 2026Updated 5 months ago
Alternatives and similar repositories for tinyserve
Users that are interested in tinyserve are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A dumb launcher to spawn swaylock and ensure it runs no matter what☆12Apr 30, 2022Updated 4 years ago
- My wezterm config☆17Feb 18, 2023Updated 3 years ago
- Scripts and Ansible playbook to setup Arch Linux on ZFS.☆12Jun 16, 2024Updated 2 years ago
- Effortlessly deploy a hardware-passthrough (VFIO) setup for Virtual Machines (VMs) on a Linux desktop. Includes quality-of-life features …☆18Apr 3, 2025Updated last year
- Mostly Autonomous Generative Intelligence☆21Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Frequency-based KV cache pruning for llama.cpp — 25% cache reduction, improved PPL at long context. GPU compaction kernel for HIP/ROCm.☆16Apr 18, 2026Updated 4 months ago
- Run autoresearch on any NVIDIA GPUs (Works on 2-4GB+ Cards)☆25Mar 22, 2026Updated 5 months ago
- Production-grade Skill orchestration, SOP enforcement, and long-context runtime control for OpenCode☆18Mar 29, 2026Updated 5 months ago
- Cardano mainchain data on BigQuery☆11Aug 3, 2023Updated 3 years ago
- Generate lenses and prisms for your data types automatically.☆12Jan 8, 2022Updated 4 years ago
- Train Llama 3 models from scratch. Any scale, any personality. By Arianna Method.☆50May 4, 2026Updated 4 months ago
- ☆20Jul 21, 2026Updated last month
- Determinate CI is the one-stop shop for effortless Nix CI in GitHub Actions.☆16Aug 12, 2026Updated last month
- Organize JavaScript packages with the Nix package manager☆14Dec 31, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆14Jul 14, 2026Updated last month
- HappyX UI library☆15May 18, 2024Updated 2 years ago
- ☆11Aug 28, 2026Updated 2 weeks ago
- Provides a Purescript wrapper around react-testing-library to be used with purescript-react-basic-hooks☆16May 27, 2026Updated 3 months ago
- ☆15Sep 28, 2022Updated 3 years ago
- ☆13Dec 15, 2025Updated 8 months ago
- Esbuild plugin for importing WebAssembly files☆15Jun 22, 2022Updated 4 years ago
- Just a little spec(k).☆15May 16, 2022Updated 4 years ago
- A Slack Bot for Epic Card Game☆11Mar 5, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆17Nov 21, 2011Updated 14 years ago
- VuePress authentication plugin☆13Aug 16, 2019Updated 7 years ago
- A set of useful cryptographic utilities for blockchain development.☆12Sep 15, 2022Updated 3 years ago
- Superseded by github.com/poisonxa16/pxa — PXA, the set-and-forget engine for Pascal and Volta☆24Updated this week
- Tools for debugging in Django☆23Nov 19, 2009Updated 16 years ago
- This element will fire the event when the scroll to the top and bottom.☆10May 26, 2016Updated 10 years ago
- College assignment writing in which I ramble about type classes and dependent types.☆11Dec 11, 2020Updated 5 years ago
- ☆17Updated this week
- ☆14May 22, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- The PureScript Domain offers free vanity URLs for PureScript libraries and community resources.☆13Aug 14, 2024Updated 2 years ago
- A unidirectional value-based JSON codec library.☆15Oct 9, 2023Updated 2 years ago
- Algorithmically solve Slay the Spire☆19Oct 7, 2022Updated 3 years ago
- Events, behaviors, and uneventful misbehaving☆18Apr 13, 2026Updated 4 months ago
- Routing management for Halogen☆16May 6, 2022Updated 4 years ago
- A textual browser proof of concept☆17Jul 1, 2024Updated 2 years ago
- A simple pushstate router, with support for async routing logic. Bring your preferred parser, printer and state management.☆15Feb 4, 2023Updated 3 years ago