Single Request Batching API server backed by llama.cpp
☆10May 4, 2025Updated last year
Alternatives and similar repositories for llama-srb-api
Users that are interested in llama-srb-api are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repo is dedicated for an ESP32-S3-N16R8 Retro-go Gameboy .☆13Mar 9, 2026Updated 8 months ago
- A Python-based chat application utilizing a Local LLM to generate complex thought chains for various use cases such as product developmen…☆20Feb 18, 2026Updated 8 months ago
- Spec-driven iterative development companion CLI for OpenCode.☆19Jun 7, 2026Updated 5 months ago
- A daemon that automatically manages the performance states of NVIDIA GPUs.☆172Feb 24, 2026Updated 8 months ago
- Connect to MCP servers right from your shell. Plugin for simonw/llm.☆37Oct 31, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- DDS function generator (sinus/triangle/TTL) with AD9833 and AD5452☆12Nov 20, 2025Updated 11 months ago
- ☆18Aug 15, 2023Updated 3 years ago
- A beginner friendly and neat open-source AutoHotkey script collection and template. You can download or add your AutoHotkey script to thi…☆13Nov 26, 2024Updated last year
- Universal Windows 10 App (UWP) for SJCAM action camera☆10Aug 8, 2017Updated 9 years ago
- Open Source Controlled Vocabulary Keyword Catalog☆10Jan 15, 2017Updated 9 years ago
- PhotoTags Synchronizer keeps your metadata tags where it belongs...☆16May 26, 2025Updated last year
- A chrome extension to autolink twitter usernames☆13Dec 28, 2015Updated 10 years ago
- Super simple python connectors for llama.cpp, including vision models (Gemma 3, Qwen2-VL). Compile llama.cpp and run!☆31Dec 11, 2025Updated 11 months ago
- Build APIs with ComfyUI☆35Sep 12, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A proxy that hosts multiple single-model runners such as LLama.cpp and vLLM☆12May 30, 2025Updated last year
- Crashbench is a LLM benchmark to measure bug-finding and reporting capabilities of LLMs☆14Aug 7, 2026Updated 3 months ago
- Slack for AI Agents☆23Mar 6, 2026Updated 8 months ago
- ☆13Jun 18, 2024Updated 2 years ago
- ☆12Dec 30, 2025Updated 10 months ago
- Queue system for dispatching FFmpeg jobs, used for @uwutube, powered by @fastify and @redis☆11Feb 12, 2022Updated 4 years ago
- A local, multimodal embedding server and vector database using NVIDIA's Omni-Embed-Nemotron-3B. This project allows you to generate embed…☆11Nov 27, 2025Updated 11 months ago
- an open experimental coding harness☆20Nov 5, 2026Updated last week
- Bluetooth Low Energy framework for communicating with Combustion Inc. Predictive Thermometers.☆11Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- embeddable llm agent in c with lua plugins☆13Updated this week
- The J-Core Jx Platform board hardware.☆17Jun 21, 2020Updated 6 years ago
- The content of the (new) Psion Documentation Project.☆11Oct 7, 2023Updated 3 years ago
- 🤖 AI-powered CLI for file reorganization. Runs fully locally — no data leaves your machine.☆20Jul 2, 2025Updated last year
- Plain CSS component framework with semantic classes, universal variants, small tokens, theme hooks, and progressive enhancements.☆12Updated this week
- Tiered optimizer state allocation for memory efficient MoE training. Cuts optimizer memory by 97.4%, outperforming AdamW/Muon/Lion while …☆14Sep 10, 2026Updated 2 months ago
- Session demos for Build AI Apps at Fabric Conference 2024☆10Jul 3, 2024Updated 2 years ago
- ☆11Oct 18, 2026Updated 3 weeks ago
- 3Dprint profiles for Flashforge printers in Ultimate Cura slicer.☆11Jun 23, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆12May 30, 2025Updated last year
- Build modern UIs in Jupyter with Python☆12Dec 28, 2022Updated 3 years ago
- A refeference of text models that can be used in the AI Horde☆13Updated this week
- Just a small collection of packages for Turris OS(OpenWRT) that I build in my free time. Don't expect anything. Not even that it builds..…☆15Jun 10, 2021Updated 5 years ago
- ☆18Oct 9, 2018Updated 8 years ago
- A LD_PRELOAD library to share CUDA VRAM weights across multiple processes using IPC.☆12Jun 30, 2026Updated 4 months ago
- An app that let's you create an outline of a book and then convert the outline into prompts that can be fed into an AI to get back prose☆10Nov 6, 2025Updated last year
Are these results useful?