The htop for LLM inference see exactly where every GB of VRAM goes and get measured quantization savings.
☆70Aug 11, 2026Updated 2 weeks ago
Alternatives and similar repositories for llm-inspector
Users that are interested in llm-inspector are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🚀 Autonomous AI Research Engineer powered by MCP | Give it a task, watch it research the web, query your knowledge base, write & execute…☆17Feb 9, 2026Updated 6 months ago
- ☆11Jul 11, 2023Updated 3 years ago
- PXQ: PXA-native low-bit MoE quants (2/3/4-bit, E16-row scales) + fused CUDA kernels for Pascal/Volta — run a real 35B on a salvaged 12-16…☆18Updated this week
- BFI National Archive automated Image Sequence preservation scripts written in Python for use with Media Area RAWcooked and other open sou…☆15Aug 20, 2026Updated last week
- Tool-native dataset generation skill for Codex, Claude Code, and Antigravity with SFT/DPO pipelines, verification, deduplication, and fle…☆20Aug 8, 2026Updated 3 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Real-time 3D visualisation of SAE feature activations inside GPT-2, token by token☆20May 19, 2026Updated 3 months ago
- Dynamic LLM model swapping system with Docker, vLLM integration, and GPU acceleration. Supports GGUF & Hugging Face models with automatic…☆23Mar 6, 2026Updated 5 months ago
- A zero-allocation, header-only C++ BPE tokenizer for Qwen, built for maximum inference throughput.☆23Apr 3, 2026Updated 4 months ago
- Reproducible llama.cpp configs + per-category quality benches for Qwen3.6-27B on a single RTX 4090. Winners, dead ends, and the silent-co…☆24Apr 26, 2026Updated 4 months ago
- ☆11Jul 3, 2024Updated 2 years ago
- ☆12Oct 17, 2024Updated last year
- Create RDF data from Excel spreadsheets - edit SKOS vocabularies, knowledge graph instances, SHACL constraints, OWL ontologies in Excel f…☆29Aug 20, 2026Updated last week
- [H] HyperspaceDB is a high-performance, vector database. It features 1-bit quantization, async replication, and native support for hierar…☆151Jul 27, 2026Updated last month
- Automatically generate Doom-metal album covers☆10May 29, 2015Updated 11 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- this repository is used for web3.js priactice☆10Mar 24, 2022Updated 4 years ago
- Adaptive Reasoning Engine for Efficient and Context-Aware Intelligence☆49Nov 15, 2025Updated 9 months ago
- ☆12Feb 2, 2023Updated 3 years ago
- AsyncIO-powered python DSL for running commands locally, on docker, or over ssh.☆13May 21, 2019Updated 7 years ago
- A simple HTTP server that wraps an unofficial free WhatsApp API.☆21Jul 5, 2026Updated last month
- Porting of the http://open.gl/ OpenGL tutorials sample code from C++ and SFML to Python and Pyglet☆11Aug 2, 2015Updated 11 years ago
- Recibo: encrypted memos for ERC-20 transactions.☆15Jun 18, 2026Updated 2 months ago
- A weather monitoring Dashboard built upon Python and Yahoo API☆14Jun 10, 2015Updated 11 years ago
- A lightweight, dependency-free JavaScript date picker supporting single, multiple, range, and multi-range selection modes.☆15Jul 19, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆11Feb 28, 2024Updated 2 years ago
- Typecast is an experimental python library for defining casts between classes.☆13Oct 14, 2016Updated 9 years ago
- Never forget the resource that helps to close that sales call! Power a real-time speech-to-text agent with retrieval augmented generation…☆14Jan 23, 2024Updated 2 years ago
- Mini-Projects using Cutting-Edge AI Frameworks☆16Aug 2, 2026Updated 3 weeks ago
- Easy going emails with Python for easy going people, who email☆14Jan 13, 2025Updated last year
- Interact with various LLMs in your browser (LangChain.js, Angular)☆17Updated this week
- Python module for creating development environments as Docker containers, similar to virtualenv.☆17May 30, 2016Updated 10 years ago
- Curadoria dos melhores links compartilhados no grupo https://t.me/nlpbr no Telegram.☆12Apr 10, 2024Updated 2 years ago
- Things and stuff for times, dates and datetimes. Maybe they're useful☆14Aug 1, 2018Updated 8 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- LLM terms explained from an engineering perspective with the production implications, not just the definition.☆47May 23, 2026Updated 3 months ago
- ☆42Aug 4, 2026Updated 3 weeks ago
- Learn how to build a socially responsible portfolio☆11May 26, 2019Updated 7 years ago
- 🧰 Small (~0.2MB) set of tools to expand the PSL.☆15Oct 18, 2023Updated 2 years ago
- Analysis of GoT dialogues using NLP techniques.☆12Mar 8, 2019Updated 7 years ago
- llmBench is a high-depth benchmarking tool designed to measure the raw performance of local LLM runtimes (Ollama, llama.cpp) while provid…☆48Mar 15, 2026Updated 5 months ago
- ☆17Oct 19, 2025Updated 10 months ago