See inside any GGUF: where two quantizations part ways, token by token, and what each sampler cuts. Live in your browser, powered by llama.cpp (CUDA or Vulkan).
β73Nov 15, 2026Updated this week
Alternatives and similar repositories for inside-llm
Users that are interested in inside-llm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Saving your tokens π₯! SparseRead enables AI agents to selectively read what matters across diverse information sources.β87Updated this week
- FusionQuant Model Merge & GGUF Conversion Pipeline - Your Free Toolkit for Custom LLMs!β14Jun 24, 2025Updated last year
- Run any large transformer model on consumer GPUs. No quantization. No compromise.β10Sep 23, 2026Updated last month
- SteerTTS: a tiny, measurably steerable English TTS. Inference code (MIT); weights at huggingface.co/WhissleAI/steer-ttsβ35Nov 3, 2026Updated last week
- Connect Chromium to LLM agents via token-efficient DOM compression. 50-200 tokens per page.β23Oct 28, 2026Updated 2 weeks ago
- Managed Kubernetes at scale on DigitalOcean β’ AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Data grid component for GPUI, built on gpui-kit. Apache-2.0.β59Updated this week
- WHIRL (Windows HIP Inference for RDNA LLMs): native Windows C++/HIP LLM inference engine for the AMD Ryzen AI Max+ 395 (Radeon 8060S) andβ¦β39Updated this week
- Evolutionary strategies finetuning library for LLMsβ26Sep 12, 2026Updated 2 months ago
- Convenience package for starting the deno lsp serverβ11Oct 23, 2026Updated 3 weeks ago
- Proof of Concept 'GeoPackage' to Arrow Converterβ11Sep 11, 2022Updated 4 years ago
- Diagnose vLLM inference serversβ18Jul 31, 2026Updated 3 months ago
- Gefen: Optimized Stochastic Optimizerβ84Oct 10, 2026Updated last month
- Mind Garden makes it easy to take notes that link to other notes.β11Mar 15, 2021Updated 5 years ago
- AI Passports & GFCI-plugs: per-integration logs & AI-auditability managed via Data-as-Stateβ13Jul 9, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer β’ AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Behavioral regression testing for AI apps and agents: pytest plugin, behavior diff, CI gate, and document extraction metricsβ23Oct 30, 2026Updated 2 weeks ago
- Process all your context faster with LLMs that can skim and selectively read what mattersβ117Updated this week
- A powerful MCP testing tool with multi-provider LLM support (Ollama, OpenAI, Claude, Gemini). Test, debug, and develop MCP servers with aβ¦β18Apr 28, 2026Updated 6 months ago
- LLM Systems Manager β real-time observability and control for LLM systemsβ12Updated this week
- Estimation and Prediction of Wet Season Calendar and Soil Water Balance for Agricultureβ16Feb 28, 2025Updated last year
- β12Nov 2, 2026Updated 2 weeks ago
- 100+ Curated, CI-verified AI workflow recipes. Powered by FlowStacks.β47Nov 4, 2026Updated last week
- Structure-aware RAG for financial document QA - 82% on FinanceBench. LLM navigates section headings instead of searching embeddings.β13Apr 15, 2026Updated 7 months ago
- Open-source PII cloaking + tamper-evident audit logs for LLM API callsβ29Oct 9, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer β’ AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Forest/Tree Data Framesβ14Jul 19, 2026Updated 3 months ago
- Long Long Term Memory Neural Net Cellsβ10Jan 25, 2022Updated 4 years ago
- Bitwarden GUI client for Sailfish OS using the official Bitwarden CLIβ13Nov 8, 2026Updated last week
- Visual-first architecture workspace with typed graphs, deterministic validation, semantic diffs, and proposal-gated AI changes.β16Aug 27, 2026Updated 2 months ago
- Stream Brave Search (web & local) results via a Model Context Protocol (MCP) / Server-Sent Events (SSE) interface. Acts as a centralized,β¦β16Apr 24, 2025Updated last year
- Offline local-first personal knowledge base with document upload, vector search, and Ollama-powered RAG chat.β12Nov 5, 2026Updated last week
- PoC. Tor and I2p Inspired, Libp2p hidden network. A small-codebase protocol powered by shared infrastructure such as libp2p.β14Aug 24, 2025Updated last year
- See what your files leak (GPS, serials, authors, failed redactions, deleted text, watermarks), then scrub them.β16Updated this week
- Whole-disk file search for Windows: any file by name in a millisecond, search inside your files, a search bar on Alt+Shift+Space and a trβ¦β21Oct 18, 2026Updated 3 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Proof-of-Concept: Secure File Sharing via IPFS + Nostr DMsβ14Aug 18, 2025Updated last year
- Stable Because Stuck: NALU Selects, It Doesn't Computeβ17Sep 24, 2026Updated last month
- Qwen3.8-Flash-Next at 262K context on an RTX 5090 + RTX 4070 Ti SUPER with 32 GB RAM: Strata patches (prefill on the big card, conversatiβ¦β38Updated this week
- Script to help convert from scanned PDF to DjVu+OCR. Dependencies: pdfsandwich tesseract pdf2djvuβ12Jun 6, 2020Updated 6 years ago
- Create 'CREATE TABLE' and 'INSERT INTO...VALUES' SQL statements from R objectsβ11Sep 11, 2022Updated 4 years ago
- Convert {sf} geometry to Rust native primitivesβ13Updated this week
- Multi-Language subtitle generatorβ14Oct 9, 2026Updated last month
Are these results useful?