A simple docker compose setup that works (in limited testing) on Blackwell cards
☆17Oct 13, 2025Updated last year
Alternatives and similar repositories for tensorrt-llm_with_open-webui
Users that are interested in tensorrt-llm_with_open-webui are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Experimental validation: Agentic Search (context trees) vs traditional RAG for code retrieval. Agentic wins with 99% fewer tokens and 2× …☆13Jan 6, 2026Updated 9 months ago
- Terminal-based context management for AI driven development☆22Oct 3, 2025Updated last year
- TypeScript AI agent framework where personality is architecture. Specialists, not chatbots.☆22Oct 20, 2026Updated last week
- Semantic Skill Space (SSS): Injecting skill embeddings into KV cache for small-model agents to recover skill behavior with lower prompt-c…☆15Mar 2, 2026Updated 7 months ago
- Echo Mode – A semantic resonance protocol for LLM tone control☆13Oct 7, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- AI-recursive ruleset for writing and auditing prompts, skills, plans, agent instructions, memory, and handoffs☆13Aug 23, 2026Updated 2 months ago
- A modular framework of 22 AI agents, each defined by strict, human-readable YAML architectures. Six classes cover strategic planning, kno…☆13Mar 22, 2026Updated 7 months ago
- Hood debugger, based on the idea of observing functions and structures as they are evaluated.☆20Jun 3, 2018Updated 8 years ago
- Offline database schema context for LLM agents. Extract once, serve via MCP — no live DB needed.☆14Mar 16, 2026Updated 7 months ago
- A high availability distributed filesystem built on FoundationDB and fuse.☆23Mar 13, 2023Updated 3 years ago
- A simple python-based terminal tool to manage llama.cpp☆13Sep 30, 2025Updated last year
- ☆15Jun 21, 2026Updated 4 months ago
- A demo of concurrency primitives in x64 assembly☆18Jan 6, 2022Updated 4 years ago
- Modern chat UI for local LLMs with streaming, user management, and web search. Self-hosted.☆13Feb 19, 2026Updated 8 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Privacy-first Chrome MV3 extension that uses Chrome’s on-device Gemini Nano for chat and one-click page summaries—no network calls.☆13Dec 7, 2025Updated 10 months ago
- Local-first persistent memory for AI agents — captures conversations, extracts durable knowledge, resolves conflicts, and reuses relevant…☆18Sep 22, 2026Updated last month
- Probe any HTTP server for OpenAI API compliance, with an honest matrix of how the OSS implementations actually behave.☆17Aug 1, 2026Updated 2 months ago
- AI NPC Desktop Platform built with Tauri + SvelteKit + Ollama☆13Feb 15, 2026Updated 8 months ago
- Reference guide on building a scalable, distributed, fault-tolerant, task scheduler platform using Zookeeper in Java.☆13Mar 25, 2024Updated 2 years ago
- Distributed, Replicated, Protocol-generic Key-value Store in Async Rust for SMR Protocols Research☆19Sep 8, 2026Updated last month
- Gemini Omni API Prompts collection updated in real time every day, designed to help creators find inspiration faster. Free & Open Source☆20Updated this week
- ChungusHub is a local-first, privacy-focused LLM frontend for roleplay.☆41Sep 27, 2026Updated last month
- Framework that makes your LLM self-aware, loops with self-learning and persistent memory that's private. Open-source & free.☆24Aug 17, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Agent-agnostic orchestration control plane☆15Updated this week
- ☆13Jan 22, 2026Updated 9 months ago
- A small A/B test of a laconic brevity directive on three LLMs: 54 replies to safety decisions, blinded two-scorer consensus against pre-r…☆17Aug 10, 2026Updated 2 months ago
- AI watermark removal built for Apple Silicon. SynthID-class pixel regeneration, visible vendor labels and provenance metadata, with every…☆27Aug 19, 2026Updated 2 months ago
- A multi-provider AI coding agent with the persona of a Tech-Priest☆19Nov 1, 2025Updated 11 months ago
- Procedural Knowledge at Scale Improves ReasoningThis repository contains the minimal, end-to-end pipeline for reproducing the paper resul…☆21Apr 1, 2026Updated 6 months ago
- Recursively generate descriptions of every file in a directory then append that description to Nushell's ls.☆16Oct 7, 2025Updated last year
- A SKILL that turns a code diff into an evidence-backed ledger of hidden assumptions, failure modes, and falsification tests.☆20Jul 27, 2026Updated 3 months ago
- Local OpenRouter web interface for both regular chats and longform writing☆20Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Interactive multi-agent team collaboration☆13Feb 27, 2026Updated 8 months ago
- Local inference you can prove. A single-binary GGUF engine in C: serves, scores, and trains LoRA through the quantized weights it deploys…☆29Updated this week
- Reinforcing LLM Reasoning through Self-Training and Value-Guided Decoding☆19May 6, 2026Updated 5 months ago
- [ARCHIVED] aurora is archived. Memory → "litectx," orchestration → "bareagent"☆18May 22, 2026Updated 5 months ago
- ☆21Jul 4, 2025Updated last year
- Probably the easiest way to setup new beacon notifications in Cobalt Strike☆10Jan 7, 2022Updated 4 years ago
- Code for "All for One: LLMs Solve Mental Math at the Last Token With Information Transferred From Other Tokens"☆11Sep 11, 2025Updated last year