cloudmercato / ollama-benchmarkLinks
Handy tool to measure the performance and efficiency of LLMs workloads.
☆62Updated last month
Alternatives and similar repositories for ollama-benchmark
Users that are interested in ollama-benchmark are comparing it to the libraries listed below
Sorting:
- LLM Benchmark for Throughput via Ollama (Local LLMs)☆231Updated this week
- A versatile AI chatbot leveraging function-calling language models via Ollama. Features include advanced function calling, self-reflectio…☆17Updated 4 months ago
- ☆70Updated 3 weeks ago
- a Repository of Open-WebUI tools to use with your favourite LLMs☆226Updated 2 weeks ago
- AI powered Chatbot with real time updates.☆55Updated 7 months ago
- Simple node proxy for llama-server that enables MCP use☆13Updated 3 weeks ago
- A simple tool to anonymize LLM prompts.☆61Updated 4 months ago
- A proxy server for multiple ollama instances with Key security☆436Updated last month
- pdfLLM is a completely open source, proof of concept RAG app. Laravel + Python + Postgre and pgVector.☆43Updated 2 weeks ago
- ☆27Updated 7 months ago
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆115Updated last year
- This repository contains custom pipelines developed for the OpenWebUI framework, including advanced workflows such as long-term memory fi…☆66Updated 3 weeks ago
- Docker images and configuration to run text-generation-webui with GPU or CPU support☆29Updated last year
- Minimal Linux OS with a Model Context Protocol (MCP) gateway to expose local capabilities to LLMs.☆228Updated last week
- Open source tool for transcirption and subtitling, alternative to happyscribe.☆26Updated 3 months ago
- Run and manage MCP servers as Docker/Podman containers. Inspired by Docker compose.☆27Updated 3 weeks ago
- VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.☆182Updated 4 months ago
- A web application that converts speech to speech 100% private☆58Updated last week
- Llama.cpp runner/swapper and proxy that emulates LMStudio / Ollama backends☆20Updated last week
- An MCP Server for Ollama☆73Updated last month
- Optimized Ollama LLM server configuration for Mac Studio and other Apple Silicon Macs. Headless setup with automatic startup, resource op…☆193Updated 2 months ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆71Updated 8 months ago
- A Discord bot for large language models. Add Gemini 2.5 Pro, Claude Sonnet 3.7, GPT 4.1, and other models. Easily change models, edit pro…☆82Updated last month
- Benchmark your local LLMs.☆48Updated 9 months ago
- Create Linux commands from natural language, in the shell.☆110Updated 7 months ago
- ☆33Updated 2 months ago
- ☆24Updated 4 months ago
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Modified to use local Ollama endpoint☆50Updated 7 months ago
- An OpenAI API compatible speech to text server for audio transcription and translations, aka. Whisper.☆76Updated 4 months ago
- Enable tool/function calling for any LLM, in OpenAI and Ollama API formats, adding universal function calling to models without native su…☆40Updated 3 weeks ago