EXL3 (ExLlamaV3 trellis quantization) in stock SGLang and vLLM on RTX 3090 and Intel Arc B70, bit-exact with ExLlamaV3
☆13Oct 16, 2026Updated last month
Alternatives and similar repositories for trellis-serve
Users that are interested in trellis-serve are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- My attempt at absolutely maxxing out my gaming PC for AI inference via the intel Arc B70 platform☆17Aug 26, 2026Updated 2 months ago
- Streaming privacy for LLM apps: pii-leak-benchmark (does your gateway leak PII in streams?), chunk-invariance (one-line test for split-bo…☆17Updated this week
- Pinned Intel Arc Pro B60/B70 inference recipes, engine patches and measurement records: Qwen3.8-27B EXL3 on one card (262,144 context, 63…☆199Updated this week
- ☆17Oct 20, 2026Updated 3 weeks ago
- Use an ESP8266 to send data from a JBD BMS (AP21S001) to a MQTT broker☆10Jul 12, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Open pipeline for the public record of US markets: congress trades, insider filings, 13F holdings, government contracts, lobbying, short-…☆48Nov 2, 2026Updated 2 weeks ago
- AWSKMS-based Solana signer (ED25519) with enterprise-grade security. Sign transactions and messages using keys stored in AWS KMS without …☆13Updated this week
- YouTube competitor tracking + content pipeline skill for Claude Code / OpenClaw agents☆14Mar 13, 2026Updated 8 months ago
- Free CC0 daily dumps of the public record of US markets: congress trades, insider filings, 13F holdings, contracts and grants, lobbying, …☆27Sep 24, 2026Updated last month
- Chrome/Firefox extension to display the full content of articles in Feedly☆10Aug 11, 2021Updated 5 years ago
- ☆12Apr 28, 2017Updated 9 years ago
- Allow Mullvad and Netbird to coexist☆17May 13, 2026Updated 6 months ago
- Expose Kind LoadBalancer to the Public☆14Nov 5, 2023Updated 3 years ago
- GamePause for Local AI: a Windows tray app that pauses LM Studio, Ollama and other local AI servers while you game, and restores them aft…☆26Oct 18, 2026Updated 3 weeks ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Plugins for Wox☆13May 30, 2017Updated 9 years ago
- Wrap commands that might cause out-of-memory errors, and stop them before they freeze your machine☆15Sep 22, 2026Updated last month
- Dockerized FastAPI wrapper for OmniVoice — zero-shot TTS for 600+ languages with voice cloning, voice design, and OpenAI-compatible API. …☆19Apr 14, 2026Updated 7 months ago
- Zam Matrix Client☆22Updated this week
- Beautiful Chat: a Paseo plugin that redraws OMP tool calls, reasoning, prompts, approvals, and checklists☆15Nov 4, 2026Updated last week
- Build AI-powered workflows with drag-and-drop simplicity. Connect nodes, configure inputs/outputs, and visualize your entire pipeline.☆25Updated this week
- monitor for a local LLM runtime (llama-swap, NInfer, Strata, more) -- metrics ported to berth.☆15Oct 17, 2026Updated last month
- LLM-powered research knowledge base — compile raw documents into a living wiki with persistent agent memory and RAG retrieval.☆14Apr 5, 2026Updated 7 months ago
- React Native App Onboard is a customizable, easy-to-use, and efficient library for creating compelling onboarding experiences for your Re…☆12Jun 18, 2026Updated 4 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- jQuery, React and Streamlit applications written by LLMs☆16Dec 24, 2023Updated 2 years ago
- A modern web interface for managing SoftEther VPN servers, built with Vue.js and utilizing SoftEther's JSON-RPC API. This project aims to…☆13Nov 15, 2025Updated last year
- Open-source execution relay for trading alerts. TradingView webhooks or AI agents in, broker orders out. Safety rails on by default, a fu…☆34Sep 24, 2026Updated last month
- xmpp api via bosh written with nodejs☆12Mar 31, 2012Updated 14 years ago
- Run a big model on your own GPU, measure it with one protocol, and submit the result. Intake for local-ai-registry recipes.☆24Nov 2, 2026Updated 2 weeks ago
- a character-ai like UI for LLM☆10Dec 3, 2024Updated last year
- Redis APN Daemon☆14Dec 9, 2012Updated 13 years ago
- A simple simulation of the Daly Smart BMS for ESP32 via bluetooth BLE☆17Jul 1, 2024Updated 2 years ago
- Visualizing the geopolitical beliefs of language models☆20Updated this week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Javascript library to wrap sieve configuration☆15Jul 7, 2023Updated 3 years ago
- Real-time Solana memecoin trading system that monitors GMGN.ai for new token launches, screens them with ML models, and executes trade…☆19Mar 5, 2026Updated 8 months ago
- Bring your Microsoft 365 Copilot subscription into Visual Studio Code as chat models☆41Updated this week
- Interactive AI storytelling app for Windows & Android with browser multiplayer, and local or API models.☆16Oct 15, 2026Updated last month
- Solana Dex Transaction Parser. A Golang library for parsing Solana DEX swap transactions. Supports multiple DEX protocols including Jupit…☆15Nov 4, 2026Updated last week
- ☆18Jul 1, 2025Updated last year
- DNS Checker API with unlimited use, no restrictions applied. Open Source.☆20Nov 26, 2024Updated last year
Are these results useful?