☆15Oct 16, 2026Updated last week
Alternatives and similar repositories for SlimServe
Users that are interested in SlimServe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative…☆12Oct 13, 2026Updated last week
- ☆41Aug 16, 2026Updated 2 months ago
- ☆28May 20, 2026Updated 5 months ago
- ☆22May 22, 2026Updated 5 months ago
- Fermion Research fork of llama.cpp: FV5/FV5B five-value ternary types for Neutrino GGUF packs (CPU + CUDA)☆14Sep 29, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆25Apr 5, 2026Updated 6 months ago
- LLM inference in C/C++☆24Oct 1, 2026Updated 3 weeks ago
- Quick access to any large language model from your browser.☆10Feb 16, 2026Updated 8 months ago
- Hermes Notebook: handwriting-first Kindle Scribe, BOOX, and Android stylus clients for the Hermes agent gateway, with Live Pages, offline…☆21Updated this week
- ☆21Updated this week
- Serve Poolside Laguna S 2.1 (NVFP4) on the NVIDIA DGX Spark (GB10) without hanging your box. Working stack, crash-safe configs, benchmark…☆19Jul 22, 2026Updated 3 months ago
- Standalone C11 and Metal inference server for EmbeddingGemma 300M☆28Updated this week
- Measured SM121 compatibility recipe for MiniMax H3 FL2VA on one NVIDIA DGX Spark with vLLM-Omni and online FP8.☆61Updated this week
- Validated GLM-5.3 Flash recipe for 2x NVIDIA RTX PRO 6000 Blackwell 96GB: 262K context, EXL3/TR3, adaptive MTP, tools, and vision.☆61Sep 20, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Arduino Sketch for eye animatronics☆13May 13, 2019Updated 7 years ago
- An MCP server to read MCP logs to debug directly inside the client☆16May 3, 2025Updated last year
- MoJev: typed, calibrated decisions in one forward pass.☆30Sep 23, 2026Updated last month
- We cracked the secret of trending on hackernews☆13Mar 20, 2025Updated last year
- PolarEngine: vLLM plugin for PolarQuant quantized LLM inference — 75% FP16 speed at 2.3x less VRAM☆36Apr 13, 2026Updated 6 months ago
- Code for the paper *Attention Drift: What Speculative Decoding Models Learn*.☆33May 12, 2026Updated 5 months ago
- The desktop application for a local viralmind.ai training gym.☆12Apr 25, 2025Updated last year
- xllama.cpp — Optimized LLM Inference for NVidia Tesla V100-SXM2-32GB☆17Apr 29, 2026Updated 5 months ago
- A small Node.js script that polls a website and sends a notification when there's a change. Inspired by my attempts to get a close hotel …☆13Nov 10, 2022Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Real browser automation with local GLiNER2 inference and open weights. Work in progress. Contributions welcome.☆80Updated this week
- One-menu RTX 5090 setup for non-Swift Huihui Qwen3.8-27B NVFP4 with Cinference, MTP-10 and K8V4.☆34Sep 22, 2026Updated last month
- ☆13Aug 5, 2026Updated 2 months ago
- Truthful scheduler-step and streaming visualization for local LLM inference☆35Sep 6, 2026Updated last month
- Raw speed benchmark traces: Qwen3.8-27B on 4x RTX 3090. llama.cpp GGUF sweeps + 288-point vLLM vs SGLang, NVFP4 vs FP8 matrix.☆13Sep 28, 2026Updated 3 weeks ago
- ☆20Apr 26, 2026Updated 5 months ago
- ☆16Jul 21, 2026Updated 3 months ago
- AWS SAM Lambda and SQS demo☆11Jun 27, 2018Updated 8 years ago
- Get file information based on file signature☆16Sep 11, 2015Updated 11 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Run oversized sparse MoE GGUF models with bounded NVMe-to-RAM-to-VRAM caching, native multi-GPU planning, and a Linux desktop Studio.☆20Oct 12, 2026Updated last week
- React AWS S3 upload using Amplify and Material UI☆10Jan 5, 2023Updated 3 years ago
- A modular framework for building massively parallel agentic systems☆35Sep 8, 2025Updated last year
- A React library for creating forms with Bootstrap☆10Jan 1, 2023Updated 3 years ago
- A Python script that scrapes your Instacart order history and saves the data in a JSON file.☆11Oct 13, 2026Updated last week
- Sequential Monte Carlo Speculative Decoding☆54Aug 25, 2026Updated last month
- Receive webhook from Stripe using a lambda setting up with Amplify☆10Nov 7, 2019Updated 6 years ago