The htop for LLM inference see exactly where every GB of VRAM goes and get measured quantization savings.
☆76Sep 28, 2026Updated last month
Alternatives and similar repositories for llm-inspector
Users that are interested in llm-inspector are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Occam's razor for Claude Code and Codex: a 30-line rule set. Benchmarks vs base: 51-55% lower estimated task cost on Opus/Sonnet 5.5 max …☆17Sep 29, 2026Updated last month
- AI Design Patterns for Galleries, Libraries, Archives, and Museums☆14Oct 2, 2026Updated last month
- flat_map standardization proposal☆11Jun 17, 2022Updated 4 years ago
- Give any LLM its own display. Send JSON, get beautiful interactive UI.☆13Mar 1, 2026Updated 8 months ago
- 🚀 Autonomous AI Research Engineer powered by MCP | Give it a task, watch it research the web, query your knowledge base, write & execute…☆17Feb 9, 2026Updated 8 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Browser-based audio-reactive visualizer inspired by Winamp and MilkDrop☆19Oct 20, 2026Updated last week
- ☆17Jul 12, 2026Updated 3 months ago
- GoalOS AGIALPHA Ascension — Sovereign Machine Economy: proof-settled autonomous AI work, Evidence Dockets, validator-gated jobs, governed…☆15Oct 26, 2026Updated last week
- ☆20Aug 26, 2026Updated 2 months ago
- Pi compaction that reuses the server's prefix cache (vLLM / SGLang / llama.cpp Anthropic endpoints): no cold re-prefill, plus a warm-up s…☆23Oct 16, 2026Updated 2 weeks ago
- Rust agent orchestration library for tool-using, long-horizon, traceable AI systems.☆16Oct 17, 2026Updated 2 weeks ago
- A versioned Analytics Agent on top of DuckDB☆29Oct 25, 2026Updated last week
- table extarctor web app ai powered.☆17May 5, 2026Updated 5 months ago
- An agentic runtime that enables secure, extensible and configurable AI automation from any model☆17Oct 17, 2026Updated 2 weeks ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Super fast Jev like server in JS, model agnostic, working with any OpenAI compatible endpoint☆24Oct 5, 2026Updated 3 weeks ago
- Cognitive ecosystem framework pairing Active Inference agent models with an Obsidian-compatible markdown knowledge graph — generates exec…☆16Oct 25, 2026Updated last week
- ☆15Feb 23, 2026Updated 8 months ago
- ☆10Feb 28, 2023Updated 3 years ago
- This repository contains a C implementation of matrix multiplication with various optimization techniques.☆14Jun 7, 2025Updated last year
- A even lighterweight subagent extension for the pi coding agent☆23Oct 23, 2026Updated last week
- Stop prompting your agents to behave. Start engineering them to.☆26Apr 17, 2026Updated 6 months ago
- Pi coding agent extension for focused code retrieval, grounded edits, safety checks, and language-server support.☆30Oct 25, 2026Updated last week
- HypercrawlTurbo is a turbocharged web scraper for extracting URLs from a webpage.☆11May 26, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [H] HyperspaceDB is a high-performance, vector database. It features 1-bit quantization, async replication, and native support for hierar…☆163Oct 16, 2026Updated 2 weeks ago
- ☆11Jul 3, 2024Updated 2 years ago
- Losslessly compress the tool output your AI agent sends the model, prove every value survived, and report the exact tokens removed. Run i…☆40Oct 23, 2026Updated last week
- Quiz generation from your docs - Streamlit LLM Hackathon project☆11Sep 30, 2023Updated 3 years ago
- Tool-native dataset generation skill for Codex, Claude Code, and Antigravity with SFT/DPO pipelines, verification, deduplication, and fle…☆21Aug 8, 2026Updated 2 months ago
- Chat language model that can interpret and execute functions/plugins☆14Oct 16, 2024Updated 2 years ago
- this repository is used for web3.js priactice☆10Mar 24, 2022Updated 4 years ago
- A simple, observable code-writing agent builder in TypeScript.☆33Apr 9, 2025Updated last year
- Reproducible llama.cpp configs + per-category quality benches for Qwen3.6-27B on a single RTX 4090. Winners, dead ends, and the silent-co…☆24Apr 26, 2026Updated 6 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Your opensource AI coworker☆42Updated this week
- ☆29Dec 30, 2025Updated 10 months ago
- Props AI provides this open source proxy for Open AI that allows you to track token usage and send it into a kafka stream☆11Mar 12, 2024Updated 2 years ago
- A lightweight React app leveraging Speech Command Recognition from Tensorflow.Js☆16Feb 3, 2021Updated 5 years ago
- Download porn videos (Python)☆14Apr 12, 2018Updated 8 years ago
- In this project, I developed a Food and Calorie Tracker API using FastAPI, PostgreSQL, OAuth2, and JWT for secure user authentication. Th…☆12Oct 28, 2024Updated 2 years ago
- Global scenarios of the Ocean Health Index☆21Dec 4, 2025Updated 10 months ago