Bounded, inspectable LLM inference pipelines from declared YAML — runs offline against Ollama or any OpenAI-compatible local server, emitting JSONL traces, inspect reports, and stable exit codes.
☆46Jul 7, 2026Updated 4 months ago
Alternatives and similar repositories for llmff
Users that are interested in llmff are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Zaxy turns agent work into durable, auditable memory: a hash-chained Eventloom log as the source of truth, an embedded temporal knowledge…☆17Aug 10, 2026Updated 3 months ago
- SparkHome: a tvOS-style home screen and voice assistant for the NVIDIA DGX Spark. Plugins for controllers, tiles and connectors; MCP for …☆39Nov 2, 2026Updated last week
- Experiments for the spectral neuron paper☆23Sep 5, 2026Updated 2 months ago
- LLMs take the path of least resistance. Pre-Reasoning hands any model a map of the problem first, so it unlocks the knowledge it already …☆19Sep 21, 2026Updated last month
- Turn standard web forms into structured WebMCP tools for compatible browser agents.☆19Oct 22, 2026Updated 3 weeks ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Eventloom is a local-first TypeScript runtime for multi-agent systems built around an append-only event log.☆13Jun 2, 2026Updated 5 months ago
- ☆12Apr 8, 2026Updated 7 months ago
- Open-source autonomous AI dev team: Sensei orchestrates specialist agents from idea to shipped product. The engine behind KageOps.☆13Aug 1, 2026Updated 3 months ago
- Simple meeting diarization and speaker id assistant for meetings.☆12Feb 10, 2025Updated last year
- Interview-based system prompts for developing research grant applications (FRIPRO, the ERC Consolidator Grant and MSCA Doctoral Networks;…☆26Updated this week
- Portable Agent Skill to plan, spawn, review, and merge parallel CLI agents in isolated git worktrees, with deterministic Python/Bash runn…☆34Apr 12, 2026Updated 7 months ago
- ISONGraph is a multi-language property graph library designed specifically for LLM and AI applications. It provides the most token-effici…☆19Nov 5, 2026Updated last week
- Open-source, self-hostable AI-native docs platform. Humans and AI agents as peer co-editors. Phase 1: architecture and ADRs.☆21Jul 2, 2026Updated 4 months ago
- Open quantization tooling for TurboQuant-style low-bit LLM releases, stock GGUF deployment, and Apple Silicon runtime experiments.☆10May 5, 2026Updated 6 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- GLM-5.2 Quantrio INT4/INT8 Mixed Abliterated — SPEED=1 C1≈30 tok/s @ 128k on 4x DGX Spark. Step-by-step recipe, image bake, results.☆13Jul 18, 2026Updated 3 months ago
- Eight-system DGX Spark engineering: fabric repair, NCCL tuning, rack recabling, custom 3D-printed PSU supports, and thermal validation.☆11Aug 3, 2026Updated 3 months ago
- Proxima lets existing GPUs serve 4x more concurrent requests☆26Aug 19, 2026Updated 2 months ago
- Self-hosted market-research terminal: SEC filings, market data on your own vendor keys, and 37 read-only MCP tools for your own AI agent.…☆20Updated this week
- GLM-5.2 744B with a true 4-bit NVFP4 KV cache on 4x DGX Spark: 42 tok/s peak, 317K-token KV pool (+58.6% vs fp8), needle-verified at 250K…☆15Jul 21, 2026Updated 3 months ago
- Model-agnostic LLM benchmarking + tuning in one command. A model is a 15-key profile file. Built in production on a 4x NVIDIA DGX Spark c…☆10Sep 16, 2026Updated last month
- A RFC Compliant Verified DNS server☆13Jul 17, 2026Updated 3 months ago
- ☆19Oct 18, 2026Updated 3 weeks ago
- A swarm of LLM agents that will help you test, document, and productionize your code!☆20Oct 26, 2026Updated 2 weeks ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- 🚗 LIMCARS Local Inference Monitor · Cost Analyzer · Recipe Server☆13Updated this week
- An auto clicker app that can discreetly keep your windows active through user interactions without interrupting your workflow, even when …☆14Dec 28, 2025Updated 10 months ago
- Claude - Production LLM Runtime Alignment Context Injection☆14Sep 19, 2026Updated last month
- Native desktop app & game engine in HTML/CSS/JS with 3D, Jolt physics, audio, on-device AI, GPU shaders, and in-process SMT verification …☆14Updated this week
- ☆37Apr 26, 2026Updated 6 months ago
- Concurrency Patch to enable on DSpark - DeepSeek V4 Flash/Pro C=16 can be modified for more☆12Jun 29, 2026Updated 4 months ago
- AI assistants that do real work, built your way, on your own machine. Any model, hosted or local, from any browser or the fxbot app o…☆16Updated this week
- repo behind the site☆10Sep 29, 2015Updated 11 years ago
- keys- 1M context: Inkling-Small-NVFP4 + DSpark + NVFP4 KV on SGLang, sm_121a-optimized on Two DGX Sparks — one-shot agent-executable rec…☆10Aug 17, 2026Updated 2 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Optimized two-node DGX Spark deployment recipe for DeepSeek V4 Flash with vLLM, DSpark, and NVFP4 KV cache☆11Aug 12, 2026Updated 3 months ago
- Dynamic-island notch for Omarchy showing live Claude Code (and Grok Bot) agents — animated faces, alerts, ask Claude from the notch☆16Oct 3, 2026Updated last month
- Classify first. Read selectively. A portable agent plugin and MCP tool for batch text classification.☆50Sep 18, 2026Updated last month
- Do multiple agents sharing a single asymmetrically-compressed KV pool produce quality output comparable to full-precision per-agent KV ca…☆13Apr 26, 2026Updated 6 months ago
- Teach GLM-5.2 to see art: minimal frozen-backbone vision-projector training (method by Harry Partridge)☆14Jul 18, 2026Updated 3 months ago
- ☆10Jan 11, 2025Updated last year
- Todoist in the Omarchy bar: a compact task list, rich Quick Add, editing, and drag-to-reorder. Native QML, direct API.☆16Updated this week
Are these results useful?