cloudmercato / ollama-benchmarkLinks
Handy tool to measure the performance and efficiency of LLMs workloads.
☆73Updated 9 months ago
Alternatives and similar repositories for ollama-benchmark
Users that are interested in ollama-benchmark are comparing it to the libraries listed below
Sorting:
- LLM Benchmark for Throughput via Ollama (Local LLMs)☆329Updated 2 weeks ago
- Nginx proxy server in a Docker container to Authenticate & Proxy requests to Ollama from Public Internet via Cloudflare Tunnel☆158Updated 5 months ago
- This repository contains custom pipelines developed for the OpenWebUI framework, including advanced workflows such as long-term memory fi…☆84Updated 8 months ago
- Download models from the Ollama library, without Ollama☆121Updated last year
- Optimized Ollama LLM server configuration for Mac Studio and other Apple Silicon Macs. Headless setup with automatic startup, resource op…☆279Updated last week
- llmbasedos — Local-First OS Where Your AI Agents Wake Up and Work☆282Updated 3 weeks ago
- ☆28Updated last year
- Code execution utilities for Open WebUI & Ollama☆318Updated last year
- ☆100Updated 4 months ago
- ☆101Updated last month
- QA-Pilot is an interactive chat project that leverages online/local LLM for rapid understanding and navigation of GitHub code repository.☆317Updated 5 months ago
- A proxy server for multiple ollama instances with Key security☆575Updated 2 weeks ago
- AI powered Chatbot with real time updates.☆71Updated last year
- VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.☆183Updated last year
- beep boop 🤖 (experimental)☆118Updated last year
- Open‑WebUI Tools is a modular toolkit designed to extend and enrich your Open WebUI instance, turning it into a powerful AI workstation. …☆511Updated last month
- A versatile AI chatbot leveraging function-calling language models via Ollama. Features include advanced function calling, self-reflectio…☆17Updated last year
- Web UI and API for managing MCP Orchestrator (mcpo) instances and configurations☆128Updated 8 months ago
- The Fastest Way to Fine-Tune LLMs Locally☆333Updated last month
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆102Updated 10 months ago
- This project implements an asynchronous deep research tool for Open WebUI that performs iterative internet searches using a SearXNG-compa…☆27Updated 6 months ago
- High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model di…☆133Updated this week
- Create Linux commands from natural language, in the shell.☆122Updated 5 months ago
- Wraps any OpenAI API interface as Responses with MCPs support so it supports Codex. Adding any missing stateful features. Ollama and Vllm…☆146Updated 2 months ago
- This is a cross-platform desktop application that allows you to chat with locally hosted LLMs and enjoy features like MCP support☆227Updated 5 months ago
- A terminal utility for intelligent shell command generation☆314Updated 2 months ago
- A simple, lightweight shell script to interact with OpenAI or Ollama or Mistral AI or LocalAI or ZhipuAI from the terminal, and enhancing…☆116Updated last year
- Generate and execute command line commands using LLM☆50Updated 11 months ago
- Guide on text completion large language model fine-tuning, including example scripts and training data acquiring.☆87Updated 11 months ago
- llm-eval-simple is a simple LLM evaluation framework with intermediate actions and prompt pattern selection☆57Updated last month