Llama.cpp runner/swapper and proxy that emulates LMStudio / Ollama backends
☆55Aug 21, 2025Updated 7 months ago
Alternatives and similar repositories for llama-runner
Users that are interested in llama-runner are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- llama-swap + a minimal ollama compatible api☆54Mar 14, 2026Updated last week
- A simple, "Ollama-like" tool for managing and running GGUF language models from your terminal.☆23Jan 2, 2026Updated 2 months ago
- ACE-Step: A Step Towards Music Generation Foundation Model☆51May 20, 2025Updated 10 months ago
- Simple node proxy for llama-server that enables MCP use☆19May 10, 2025Updated 10 months ago
- Locally hosted AI Agent Python Tool To Generate Novel Research Hypothesis + Titles + Abstracts☆30Apr 30, 2025Updated 10 months ago
- NordVPN Threat Protection Pro™ • AdTake your cybersecurity to the next level. Block phishing, malware, trackers, and ads. Lightweight app that works with all browsers.
- KoboldCpp Smart Launcher with GPU Layer and Tensor Override Tuning☆31May 18, 2025Updated 10 months ago
- Give your local LLM a real memory with a lightweight, fully local memory system. 100% offline and under your control.☆69Sep 16, 2025Updated 6 months ago
- Schema-aware JSON compression with millisecond lookups — cut transfer/storage while enabling exists /pos queries. (Demo + wheels; core is…☆24Feb 21, 2026Updated last month
- FlexAudioPrint is a Python-based app for transcribing audio to text using OpenAI's Whisper model. It offers a Gradio web interface and a …☆10Jan 29, 2026Updated last month
- A web application that converts speech to speech 100% private☆84Jun 3, 2025Updated 9 months ago
- ☆229May 7, 2025Updated 10 months ago
- ☆54Oct 10, 2025Updated 5 months ago
- This is a TypeScript package to add tool calling capabilities to newly released LLMs on LangChain.js's ChatOpenAI and BaseChatModel class…☆19Jun 4, 2025Updated 9 months ago
- ☆18Feb 23, 2026Updated last month
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Using deep research workflow to generate datasets for finetuning LLMs.☆39Oct 9, 2025Updated 5 months ago
- ☆20Jul 4, 2025Updated 8 months ago
- documentation used in my projects☆17Updated this week
- 🚀 FlexLLama - Lightweight self-hosted tool for running multiple llama.cpp server instances with OpenAI v1 API compatibility and multi-GP…☆53Mar 5, 2026Updated 3 weeks ago
- The easiest & fastest way to run LLMs in your home lab☆87Feb 23, 2026Updated last month
- 🍨 Gelato — From Data Curation to Reinforcement Learning: Building a Strong Grounding Model for Computer-Use Agents☆40Dec 22, 2025Updated 3 months ago
- Web application for roleplaying with AI-powered characters☆68Jul 8, 2025Updated 8 months ago
- Row-wise block scaling for fp8 quantization matrix multiplication. Solution to GPU mode AMD challenge.☆18Feb 9, 2026Updated last month
- 🕷️ n8n Community Node for Scrappey API – Automate web scraping and data extraction with advanced anti-bot blocking technology, seamlessl…☆16Feb 2, 2026Updated last month
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆19Dec 9, 2025Updated 3 months ago
- Voice Cloning, Now Inside Kokoro. Generate natural multilingual speech and clone any target voice with ease.☆65Updated this week
- Offline LLM chatbot with personalized memory — works on CPU with multi-session memory support.☆22Jan 10, 2026Updated 2 months ago
- A wrapper around libssh2 for .NET☆30Jan 21, 2026Updated 2 months ago
- Personal Finance Expense Tracker☆20Nov 14, 2025Updated 4 months ago
- This repo documents my workflows and stack to run comfy ui GenANI assist under windows☆32Feb 14, 2026Updated last month
- [NeurIPS 2025, Spotlight]: Ambient-o: Training Good models with Bad Data.☆33Jan 21, 2026Updated 2 months ago
- Generate a llama-quantize command to copy the quantization parameters of any GGUF☆31Jan 23, 2026Updated 2 months ago
- Get up and running with Llama 2 and other large language models locally☆15Mar 19, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- Run a <400ms latency Voice Agent on just 4GB VRAM. Fully offline, no API keys required. Optimized for GTX 1650 and edge robotics with zer…☆71Feb 22, 2026Updated last month
- CLaMR: Contextualized Late-Interaction for Multimodal Content Retrieval☆24Jun 28, 2025Updated 8 months ago
- ☆24May 8, 2025Updated 10 months ago
- TLS & API keys for your LLM APIs☆20Dec 17, 2025Updated 3 months ago
- Real-time webcam demo with SmolVLM(mlx-community/SmolVLM-Instruct-4bit) and MLX-VLM☆25Jun 12, 2025Updated 9 months ago
- A powerful, interactive Python CLI for converting, manipulating, and inspecting media files using FFmpeg 🎬☆17Mar 16, 2026Updated last week
- implementations of some research papers 😴😴☆22Jul 28, 2025Updated 7 months ago