cloudmercato / ollama-benchmark
Handy tool to measure the performance and efficiency of LLMs workloads.
☆51Updated 2 months ago
Alternatives and similar repositories for ollama-benchmark:
Users that are interested in ollama-benchmark are comparing it to the libraries listed below
- LLM Benchmark for Throughput via Ollama (Local LLMs)☆203Updated last month
- a Repository of Open-WebUI tools to use with your favourite LLMs☆182Updated last week
- Nginx proxy server in a Docker container to Authenticate & Proxy requests to Ollama from Public Internet via Cloudflare Tunnel☆93Updated last month
- A proxy server for multiple ollama instances with Key security☆373Updated this week
- Docker images and configuration to run text-generation-webui with GPU or CPU support☆28Updated last year
- 🔥 LitLytics - an affordable, simple analytics platform that leverages LLMs to automate data analysis☆97Updated 4 months ago
- ☆67Updated 2 weeks ago
- Optimized Ollama LLM server configuration for Mac Studio and other Apple Silicon Macs. Headless setup with automatic startup, resource op…☆152Updated 3 weeks ago
- beep boop 🤖☆90Updated 2 months ago
- AI powered Chatbot with real time updates.☆50Updated 5 months ago
- update your ollama models to the latest☆80Updated last month
- VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.☆181Updated 2 months ago
- Web Interface for Vision Language Models Including InternVLM2☆20Updated 8 months ago
- An OpenAI API compatible speech to text server for audio transcription and translations, aka. Whisper.☆71Updated last month
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆115Updated 10 months ago
- Rivet plugin for integration with Ollama, the tool for running LLMs locally easily☆37Updated 11 months ago
- Link you Ollama models to LM-Studio☆132Updated 8 months ago
- Code execution utilities for Open WebUI & Ollama☆264Updated 4 months ago
- Welcome to echonotes! This is an exciting and powerful Python application designed to automate the process of extracting handwritten note…☆47Updated 6 months ago
- A Tiny Terminal Chat App for AI Models with MCP Client Support☆66Updated this week
- Open source tool for transcirption and subtitling, alternative to happyscribe.☆25Updated last month
- ☆83Updated 3 months ago
- Lightweight Inference server for OpenVINO☆143Updated this week
- RetroChat is a powerful command-line interface for interacting with various AI language models. It provides a seamless experience for eng…☆72Updated 3 months ago
- Your AI mate into your favourite terminal☆66Updated this week
- A command-line utility to manage MLX models between your Hugging Face cache and LM Studio.☆32Updated last month
- ☆26Updated last month
- API up your Ollama Server.☆144Updated 3 months ago
- Self-host LLMs with vLLM and BentoML☆97Updated this week
- reddacted lets you clean up your online footprint surgically by analyzing the content of comments to identify anything that might be like…☆48Updated this week