aidatatools / ollama-benchmarkLinks
LLM Benchmark for Throughput via Ollama (Local LLMs)
☆231Updated this week
Alternatives and similar repositories for ollama-benchmark
Users that are interested in ollama-benchmark are comparing it to the libraries listed below
Sorting:
- Handy tool to measure the performance and efficiency of LLMs workloads.☆62Updated last month
- A proxy server for multiple ollama instances with Key security☆436Updated last month
- a Repository of Open-WebUI tools to use with your favourite LLMs☆226Updated 2 weeks ago
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆115Updated last year
- A open webui function for better R1 experience☆79Updated 3 months ago
- Benchmark llm performance☆95Updated 10 months ago
- VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.☆182Updated 4 months ago
- You don’t need to read the code to understand how to build!☆198Updated 4 months ago
- Lightweight Inference server for OpenVINO☆180Updated this week
- An OpenAI API compatible speech to text server for audio transcription and translations, aka. Whisper.☆76Updated 4 months ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆71Updated 8 months ago
- ☆90Updated 5 months ago
- automatically quant GGUF models☆181Updated this week
- API up your Ollama Server.☆154Updated 2 months ago
- Export and Backup Ollama models into GGUF and ModelFile☆71Updated 8 months ago
- beep boop 🤖 (experimental)☆110Updated 4 months ago
- OpenAPI Tool Servers☆441Updated this week
- Example Pipelines for Open-WebUI☆75Updated 3 months ago
- InferX is a Inference Function as a Service Platform☆106Updated this week
- MAESTRO is an AI-powered research application designed to streamline complex research tasks.☆155Updated 3 weeks ago
- A tool to determine whether or not your PC can run a given LLM☆163Updated 4 months ago
- The Fastest Way to Fine-Tune LLMs Locally☆300Updated 2 months ago
- This repository contains custom pipelines developed for the OpenWebUI framework, including advanced workflows such as long-term memory fi…☆66Updated 3 weeks ago
- Open source LLM UI, compatible with all local LLM providers.☆174Updated 8 months ago
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆255Updated 3 months ago
- A fast batching API to serve LLM models☆181Updated last year
- ☆198Updated 3 weeks ago
- Ollama chat client in Vue, everything you need to do your private text rpg in browser☆132Updated 7 months ago
- Welcome!☆140Updated 5 months ago
- Minimal Linux OS with a Model Context Protocol (MCP) gateway to expose local capabilities to LLMs.☆228Updated last week