aidatatools / ollama-benchmark
LLM Benchmark for Throughput via Ollama (Local LLMs)
☆220Updated 2 months ago
Alternatives and similar repositories for ollama-benchmark
Users that are interested in ollama-benchmark are comparing it to the libraries listed below
Sorting:
- Handy tool to measure the performance and efficiency of LLMs workloads.☆60Updated 2 weeks ago
- a Repository of Open-WebUI tools to use with your favourite LLMs☆219Updated this week
- A proxy server for multiple ollama instances with Key security☆421Updated last month
- Benchmark llm performance☆95Updated 9 months ago
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆115Updated 11 months ago
- beep boop 🤖 (experimental)☆108Updated 4 months ago
- OpenAPI Tool Servers☆383Updated 2 weeks ago
- Code execution utilities for Open WebUI & Ollama☆276Updated 6 months ago
- Lightweight Inference server for OpenVINO☆166Updated this week
- Serving LLMs in the HF-Transformers format via a PyFlask API☆71Updated 8 months ago
- ☆147Updated last year
- ☆89Updated 4 months ago
- Benchmark your local LLMs.☆48Updated 8 months ago
- VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.☆180Updated 3 months ago
- Download models from the Ollama library, without Ollama☆75Updated 6 months ago
- An open-source VSCode extension, the AI coding assistant, integrates with Ollama, HuggingFace, OpenAI, and Anthropic.☆226Updated last week
- Your gateway to both Ollama & Apple MlX models☆131Updated 2 months ago
- Optimized Ollama LLM server configuration for Mac Studio and other Apple Silicon Macs. Headless setup with automatic startup, resource op…☆180Updated 2 months ago
- plug whisper audio transcription to a local ollama server and ouput tts audio responses☆324Updated last year
- Review/Check GGUF files and estimate the memory usage and maximum tokens per second.☆161Updated this week
- AI powered Chatbot with real time updates.☆53Updated 6 months ago
- Model swapping for llama.cpp (or any local OpenAPI compatible server)☆745Updated this week
- Link you Ollama models to LM-Studio☆137Updated 10 months ago
- Convert Files / Folders / GitHub Repos Into AI / LLM-ready Files☆160Updated 3 months ago
- ☆95Updated this week
- ☆202Updated 3 weeks ago
- LM Studio JSON configuration file format and a collection of example config files.☆198Updated 9 months ago
- A open webui function for better R1 experience☆79Updated 2 months ago
- Interactive, locally hosted tool to migrate Open-WebUI SQLite databases to PostgreSQL☆80Updated last month
- This repository contains custom pipelines developed for the OpenWebUI framework, including advanced workflows such as long-term memory fi…☆62Updated this week