An offline coding agent for local models. One command sets up the best model your GPU can run, and on 24 GB+ RTX 30/40/50-series cards Qwen3.8-27B runs up to 1.9x faster than llama.cpp.
☆141Nov 11, 2026Updated this week
Alternatives and similar repositories for open-jet
Users that are interested in open-jet are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Qwen3.8-Flash-Next at full 262k context on 8 GB RAM and 16 GB VRAM—20 tok/s generation and 1,600 tok/s prefill.☆67Oct 26, 2026Updated 2 weeks ago
- Pi-Pocket + Batteries☆19Updated this week
- Deterministic PyGhidra extraction, triage, and local LLM compiler-backend pipeline for C reimplementation.☆11Oct 18, 2026Updated 3 weeks ago
- Source-available C++/CUDA inference engine for Qwen3.8-27B INT4 on 3x RTX 3090☆54Updated this week
- A chatbot, with a large language model split across its users, entirely in the browser.☆54Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Qwen3.8-Flash-Next at 262K context on an RTX 5090 + RTX 4070 Ti SUPER with 32 GB RAM: Strata patches (prefill on the big card, conversati…☆37Updated this week
- AI Optimized Markdown Kanban Board☆16Sep 9, 2026Updated 2 months ago
- EqualTune is a free system-wide audio equalizer for Windows. Shape everything your PC plays with a live parametric EQ, presets, per-app a…☆12Updated this week
- LLM Systems Manager — real-time observability and control for LLM systems☆12Updated this week
- Thinking blocks that open during generation: a gate decides when to think, a tree of candidate thoughts is explored, and the best one sta…☆18Oct 11, 2026Updated last month
- A deterministic inference engine for DeepSeek-V4.1-Flash 1017 and Qwen3.8-Flash-Next on a single AMD Strix Halo 128 GB☆24Updated this week
- It lets an AI agent put a live, interactive page on any screen you own, and brings what you do on it back into the conversation.☆34Updated this week
- NotebookLM on steroids — purpose-built for security researchers.☆29Jun 15, 2026Updated 5 months ago
- A FastAPI and MCP server connected to Supabase table for managing, testing, and programmatically accessing LLM System Instructions, Syste…☆14Oct 22, 2026Updated 3 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.☆284Updated this week
- llama.cpp fork for significantly improved performance on Ampere generation Nvidia cards (especially RTX 3090 / 3090 Ti): example: 110+ to…☆380Updated this week
- Almond: a multi-model engine for MoE and dense models on AMD RX 7900 XTX (ROCm/HIP) - DeepSeek-V4.1-Flash, GLM-5.3-Flash, Qwen3.8-Flash-N…☆54Updated this week
- Berth is a lightweight GPU resource manager written in Go. It controls which applications get access to your GPU, when they get it, and h…☆296Updated this week
- Galahad by Corbenic☆56Nov 4, 2026Updated last week
- Clone your own voice on your own computer: speak any text in 60+ languages and dub videos into another language in your voice. Fully loca…☆59Updated this week
- Localix Terminal: the terminal for you and your coding agents. Project sessions that come back as you left them; Claude Code, Codex or an…☆24Updated this week
- Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when …☆2,706Updated this week
- Qwen and DeepSeek low-VRAM LoRA training with GGUF base model, compatible with Transformers and PEFT☆22Nov 2, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Strixfold: DeepSeek-V4.1-Flash on two AMD Strix Halo boxes over USB4. A HIP backend and Strix Halo kernels for TensorFold.☆63Updated this week
- Local, provider-agnostic agentic hub: an orchestrator and a squad of little monsters on your machine☆16Updated this week
- On-device voice models and SDK: voice isolation, wake words, voice activity and voiceprints. In the browser (WebAssembly), Python, Androi…☆76Nov 5, 2026Updated last week
- This guide is beginner-friendly, project-driven, and laser-focused on the commands & concepts you will actually use while working with Do…☆16Dec 20, 2025Updated 10 months ago
- an experimental quantized training library☆15Nov 7, 2026Updated last week
- Find anything on your PC by what's in it: local, private semantic search for Windows. Photos, screenshots, PDFs, documents, recordings an…☆16Oct 25, 2026Updated 2 weeks ago
- A pi extension that adds a /for-$each prompt loop – and hides it from your LLM! Supports children-in-directory and line-in-files iteratio…☆19Oct 3, 2026Updated last month
- Gufo OCI Images for AMD Strix Halo☆24Updated this week
- Live structural code graph for AI agents — one-curl install wires MCP + an agent skill into Claude Code, OpenCode, Codex and Cursor. Inde…☆13Oct 24, 2026Updated 3 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Glossary of key concepts in Large Language Models (LLMs), Artificial Intelligence (AI), Natural Language Processing (NLP), and Machine Le…☆15Oct 15, 2025Updated last year
- GLM-5.3-Flash adaptation + offload perf patches for FreeToken v0.1.2 (17.8→36.7 tok/s on one RTX PRO 6000)☆21Oct 2, 2026Updated last month
- Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith …☆1,034Updated this week
- An agent / harness multiplexer that allows you to access your agents from any device and machine☆23Updated this week
- Memory system for LLMs that remembers everything you teach it during conversation. No reindexing, no context window limits. CPU by defaul…☆13May 2, 2026Updated 6 months ago
- Pure-Rust inference engine for Qwen GGUF models (Qwen3 to Qwen3.8, dense and MoE up to 770B+). CUDA and Vulkan (NVIDIA, AMD), hybrid CPU+…☆229Updated this week
- Qwen3.8-27B EXL3 + DFlash2 speculative decoding on an AMD RX 7900 XTX (exllamav3-rocm): recipe, patches, benchmarks☆23Nov 2, 2026Updated last week
Are these results useful?