WHIRL (Windows HIP Inference for RDNA LLMs): native Windows C++/HIP LLM inference engine for the AMD Ryzen AI Max+ 395 (Radeon 8060S) and Radeon AI PRO R9700. Unzip and run, only the AMD driver.
☆34Oct 23, 2026Updated this week
Alternatives and similar repositories for whirl-llm
Users that are interested in whirl-llm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- vLLM optimized for AMD☆27Oct 14, 2026Updated last week
- Use any AI model, locally or in the cloud, while tracking on-device token usage and collecting token telemetry data.☆18Aug 14, 2026Updated 2 months ago
- Working on the fastest vllm path for AMD Radeon AI PRO R9700☆78Updated this week
- Python-based cryptocurrency trading bot that functions on the Coinbase Pro exchange. This bot currently uses RSI values and 24HR Volume i…☆10May 16, 2022Updated 4 years ago
- Strix Halo inference engine. Qwen Flash Next Q4_K_XL: 1,628.52pp, 59.41tg single user, 157.22 tok/s 8 users; Qwen27B Q4_K_XL: 656.33pp, 7…☆36Oct 3, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Real-world percentile benchmark for LLM inference servers: 1% A/B resolution, offline HTML reports. I am now on X also: https://x.com/bku…☆75Oct 9, 2026Updated 2 weeks ago
- A browser in the agent's hand. 9 MCP tools, self-diagnosing verdicts, single Go binary.☆29Jul 24, 2026Updated 2 months ago
- The all-in-one AI assistant for development and content creation☆16Aug 12, 2026Updated 2 months ago
- Nocturne in Blue and Gold, the painted Rickroll: a one-minute moving oil painting with its own synthesised soundtrack, drawn entirely in …☆25Sep 24, 2026Updated 3 weeks ago
- ☆88Updated this week
- Windows desktop console for llama.cpp runtimes, models, and local coding workflows☆132Updated this week
- ☆14Sep 10, 2026Updated last month
- Open-source control panel for the real llama.cpp: see where a model lands in your VRAM before loading, every llama-server flag per model,…☆111Updated this week
- ☆21Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Train LLMs using a delightful web interface powered by magic ✨☆42Updated this week
- local cli for ai coding cost control. scans your repo, finds token waste, and generates smaller context packs for claude code, cursor, co…☆21Jul 2, 2026Updated 3 months ago
- Whole-disk file search for Windows: any file by name in a millisecond, search inside your files, a search bar on Alt+Shift+Space and a tr…☆20Updated this week
- ModSleuth builds evidence-grounded dependency graphs for LLM releases from public artifacts such as model cards, dataset cards, technical…☆17Jun 15, 2026Updated 4 months ago
- Llama.cpp launcher with integrated huggingface☆75Oct 14, 2026Updated last week
- ☆16Jun 29, 2026Updated 3 months ago
- Memory system for LLMs that remembers everything you teach it during conversation. No reindexing, no context window limits. CPU by defaul…☆14May 2, 2026Updated 5 months ago
- A micro-services based system for indexing cryptocurrencies☆16Dec 7, 2022Updated 3 years ago
- Talk to your Intel Management Engine directly — zero-dependency Python tool. Finds memory leaks, partition manifest, live MKHI probing. F…☆16Jul 30, 2026Updated 2 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Code with the complete results of the "How to make Pi more like Claude Code" tutorial☆11Sep 30, 2026Updated 3 weeks ago
- Parse expressions☆13Sep 16, 2021Updated 5 years ago
- Pi compaction that reuses the server's prefix cache (vLLM / SGLang / llama.cpp Anthropic endpoints): no cold re-prefill, plus a warm-up s…☆20Oct 16, 2026Updated last week
- Mixed-vendor GPU inference cluster manager with speculative decoding☆38Jul 2, 2026Updated 3 months ago
- Extension for Ableton live that allows you to paste a Youtube link☆21Oct 14, 2026Updated last week
- Your Claude Code agents, living in a tiny pixel-art office. Desktop widget + browser app, with tokens, a shop and a lounge.☆35Updated this week
- Windows Hardware Diagnostic & Local AI Model Advisor. Fast in-process hardware detection & intelligent local LLM recommender for Ollama.☆36Sep 1, 2026Updated last month
- Local MCP server for YNAB with read-only defaults, full API coverage, safe write controls, and support for budgets, transactions, categor…☆40Oct 14, 2026Updated last week
- Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on loca…☆25Oct 15, 2026Updated last week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Visual-first architecture workspace with typed graphs, deterministic validation, semantic diffs, and proposal-gated AI changes.☆16Aug 27, 2026Updated last month
- Agent Skill & CLI for infinite multi-harness session context. Any agent, any session, any turn.☆15Jun 26, 2026Updated 3 months ago
- Claude - Production LLM Runtime Alignment Context Injection☆14Sep 19, 2026Updated last month
- Windows adaptation of Gufo's Strix Halo inference engine. Qwen Flash Next optimized. New GUI Launcher for Windows. This is not a 1:1 port…☆19Oct 17, 2026Updated last week
- Communication interface for AI Coding Agents based on excalidraw to go beyond chats.☆19May 31, 2026Updated 4 months ago
- Miasma Malware Discovery and Mitigation Tool☆16Aug 18, 2026Updated 2 months ago
- Real-time voice conversation system with Sesame CSM, featuring web-based audio visualization and GPU acceleration. Educational implementa…☆17Mar 18, 2025Updated last year