cloudmercato / ollama-benchmark
Handy tool to measure the performance and efficiency of LLMs workloads.
☆54Updated 2 months ago
Alternatives and similar repositories for ollama-benchmark:
Users that are interested in ollama-benchmark are comparing it to the libraries listed below
- LLM Benchmark for Throughput via Ollama (Local LLMs)☆210Updated 2 months ago
- A versatile AI chatbot leveraging function-calling language models via Ollama. Features include advanced function calling, self-reflectio…☆17Updated 2 months ago
- ☆67Updated last month
- ScribePal is an Open Source intelligent browser extension that leverages AI to empower your web experience by providing contextual insigh…☆16Updated last month
- a Repository of Open-WebUI tools to use with your favourite LLMs☆199Updated last month
- AI powered Chatbot with real time updates.☆52Updated 5 months ago
- A QT GUI for large language models☆32Updated last year
- MCP Server for SearXNG☆56Updated last week
- Chat with your pdf using your local LLM, OLLAMA client.(incomplete)☆37Updated 6 months ago
- ☆27Updated 6 months ago
- A simple tool to anonymize LLM prompts.☆58Updated 2 months ago
- Fast local speech-to-text for any app using faster-whisper☆62Updated 3 weeks ago
- ☆91Updated 2 weeks ago
- Optimized Ollama LLM server configuration for Mac Studio and other Apple Silicon Macs. Headless setup with automatic startup, resource op…☆163Updated last month
- 🔥 LitLytics - an affordable, simple analytics platform that leverages LLMs to automate data analysis☆98Updated 4 months ago
- Fill up the `model_list` field in your LiteLLM proxy configuration file☆10Updated 7 months ago
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆115Updated 11 months ago
- An MCP Server for Ollama☆46Updated 2 months ago
- VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.☆181Updated 2 months ago
- Generate and execute command line commands using LLM☆46Updated 2 months ago
- OLLama IMage CAtegorizer☆66Updated 3 months ago
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆243Updated 3 weeks ago
- MCP server for connecting agentic systems to search systems via searXNG☆61Updated 2 months ago
- This repository contains custom pipelines developed for the OpenWebUI framework, including advanced workflows such as long-term memory fi…☆56Updated 4 months ago
- ✨ mem0 MCP Server: A modern memory system using mem0 for AI applications with model context protocl (MCP) integration. Enables long-term …☆36Updated 2 weeks ago
- A Discord bot for large language models. Add Gemini, Sonnet, GPT, and other models. Easily change models, edit prompts, and enable web se…☆80Updated this week
- A document based RAG application☆113Updated 3 weeks ago
- A proxy server for multiple ollama instances with Key security☆392Updated last week
- Create Linux commands from natural language, in the shell.☆109Updated 5 months ago
- LM inference server implementation based on *.cpp.☆169Updated this week