cloudmercato / ollama-benchmarkLinks
Handy tool to measure the performance and efficiency of LLMs workloads.
☆73Updated 7 months ago
Alternatives and similar repositories for ollama-benchmark
Users that are interested in ollama-benchmark are comparing it to the libraries listed below
Sorting:
- LLM Benchmark for Throughput via Ollama (Local LLMs)☆314Updated this week
- Wraps any OpenAI API interface as Responses with MCPs support so it supports Codex. Adding any missing stateful features. Ollama and Vllm…☆138Updated last month
- ☆28Updated last year
- VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.☆183Updated 10 months ago
- mcp manager, add & syncs MCP server configurations across clients like Claude code, Cursor💡 build-in Codex agent, mcphub☆237Updated last week
- Nginx proxy server in a Docker container to Authenticate & Proxy requests to Ollama from Public Internet via Cloudflare Tunnel☆153Updated 3 months ago
- ☆98Updated last month
- A proxy server for multiple ollama instances with Key security☆543Updated last month
- AI powered Chatbot with real time updates.☆67Updated last year
- Create Linux commands from natural language, in the shell.☆116Updated 3 months ago
- Code execution utilities for Open WebUI & Ollama☆310Updated last year
- llmbasedos — Local-First OS Where Your AI Agents Wake Up and Work☆278Updated 3 months ago
- Generate and execute command line commands using LLM☆50Updated 10 months ago
- Download models from the Ollama library, without Ollama☆115Updated last year
- Open Deep Researcher with openai compatible endpoint, now completely local with ollama, local playwright via searxng with citations and p…☆148Updated 8 months ago
- Tools for OpenWebUI☆142Updated 6 months ago
- MCP Server for SearXNG☆356Updated last month
- API up your Ollama Server.☆186Updated 2 months ago
- Web UI and API for managing MCP Orchestrator (mcpo) instances and configurations☆127Updated 6 months ago
- A cross patform app that unlocks your devices Gen AI capabilities☆68Updated last week
- A versatile AI chatbot leveraging function-calling language models via Ollama. Features include advanced function calling, self-reflectio…☆17Updated 10 months ago
- An MCP server to create secure code sandbox environment for executing code within Docker containers. This MCP server provides AI applicat…☆290Updated 8 months ago
- Mem0 Integration with OpenWebUI☆49Updated 2 weeks ago
- This repository contains custom pipelines developed for the OpenWebUI framework, including advanced workflows such as long-term memory fi…☆80Updated 7 months ago
- Optimized Ollama LLM server configuration for Mac Studio and other Apple Silicon Macs. Headless setup with automatic startup, resource op…☆270Updated 9 months ago
- ScribePal is an Open Source intelligent browser extension that leverages AI to empower your web experience by providing contextual insigh…☆21Updated last week
- High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model di…☆120Updated this week
- Review/Check GGUF files and estimate the memory usage and maximum tokens per second.☆219Updated 3 months ago
- This project sets up an Open WebUI interface with LiteLLM as a backend proxy for AI models. This simple setup makes adding and using vari…☆42Updated last year
- ☆74Updated 11 months ago