Interactive launcher and benchmarking harness for llama.cpp server throughput, with tests, sweeps, and round‑robin load tools.
☆427Feb 8, 2026Updated 4 months ago
Alternatives and similar repositories for llama-throughput-lab
Users that are interested in llama-throughput-lab are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- a collection of scripts to maintain a server running rtorrent, autodl-irssi, sonarr, radarr, rclone upload to Google Drive, plexdrive, Pl…☆11Aug 26, 2018Updated 7 years ago
- Technical docs to help you make you Halo Strix WORK!☆66Jan 10, 2026Updated 5 months ago
- Spreadsheet-like programming on all your devices. http://object.network/onex-app.html☆16Jun 17, 2025Updated last year
- An app that assists authors in writing novels / short stories by leveraging Large Language Models (LLMs).☆61Jun 22, 2026Updated last week
- Monika is an AI assistant that combines speech-to-text, natural language processing, and text-to-speech capabilities for seamless interac…☆26Mar 31, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Transform natural language into beautiful, interactive data visualizations using the Model Context Protocol (MCP) with Claude Desktop int…☆19Jun 27, 2025Updated last year
- A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more mo…☆13Jan 13, 2024Updated 2 years ago
- Bitcoin utilities and protocol library for interacting with the network☆15Oct 27, 2025Updated 8 months ago
- The Open Source Voice Agent Platform. Orchestrate ultra-low latency AI pipelines for real-time conversations over WebRTC.☆49Jun 28, 2026Updated last week
- FlexAudioPrint is a Python-based app for transcribing audio to text using OpenAI's Whisper model. It offers a Gradio web interface and a …☆10Apr 22, 2026Updated 2 months ago
- ☆25Feb 10, 2026Updated 4 months ago
- Yet another frontend for LLM, written using .NET and WinUI 3☆11Sep 14, 2025Updated 9 months ago
- Dia-JAX: A JAX port of Dia, the text-to-speech model for generating realistic dialogue from text with emotion and tone control.☆29May 7, 2025Updated last year
- ☆14Sep 16, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A simple, "Ollama-like" tool for managing and running GGUF language models from your terminal.☆25Jan 2, 2026Updated 6 months ago
- Random AI notes for working with local models or playing around with random machine learning bits.☆58Jun 7, 2026Updated 3 weeks ago
- A simple, fast, lean, flat file (no database) CMS for easy and quick website generation and publishing.☆14Nov 4, 2023Updated 2 years ago
- Control MHI Airconditioning locally using your own ESP32-C3!☆17Oct 2, 2025Updated 9 months ago
- 🌳 a local-first database with built-in vector and full-text search☆19Feb 15, 2025Updated last year
- Transform slides and speaker notes into video☆39Mar 1, 2026Updated 4 months ago
- KoboldCpp Smart Launcher with GPU Layer and Tensor Override Tuning☆30May 18, 2025Updated last year
- OpenWrt port for Ruckus R500 wireless access points☆12Mar 2, 2021Updated 5 years ago
- My version of an LLM Websearch Agent using a local SearXNG server because SearXNG is great.☆46Jan 27, 2026Updated 5 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Learn CIoT☆12Nov 30, 2023Updated 2 years ago
- ☆10Feb 9, 2024Updated 2 years ago
- Alpine-based docker container for chrooted ftp☆16Feb 21, 2025Updated last year
- Opus 4.6 Telegram AI assistant via Claude Max + OpenClaw. One-click setup.☆53Mar 21, 2026Updated 3 months ago
- A themeable stylesheet for Asciidoctor.☆17Jun 18, 2026Updated 2 weeks ago
- ☆13Oct 13, 2023Updated 2 years ago
- TNT☆13Jun 21, 2026Updated 2 weeks ago
- An elegant way to send message between Swift and WKWebView☆11Jun 26, 2025Updated last year
- Simple Tool Caller for llama.cpp☆11Aug 12, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- AI-Driven Decentralized Organization (AIDO) using Supabase and LangChain.js. It includes all necessary files, configurations, tests, and…☆36Nov 15, 2024Updated last year
- A modern desktop application built with Tauri 2.0 for creating professional audiobooks using advanced text-to-speech and voice cloning te…☆86Jan 4, 2026Updated 6 months ago
- ☆196Jan 11, 2026Updated 5 months ago
- ☆28Apr 28, 2025Updated last year
- Build SD card image for ODROID C1 and C1+☆15Feb 18, 2022Updated 4 years ago
- 🎮 Material You TUI for monitoring NVIDIA GPUs☆58Jan 16, 2026Updated 5 months ago
- ☆54May 28, 2025Updated last year