aidatatools / ollama-benchmark
LLM Benchmark for Throughput via Ollama (Local LLMs)
☆203Updated last month
Alternatives and similar repositories for ollama-benchmark:
Users that are interested in ollama-benchmark are comparing it to the libraries listed below
- A proxy server for multiple ollama instances with Key security☆371Updated last month
- A open webui function for better R1 experience☆79Updated 3 weeks ago
- beep boop 🤖☆90Updated 2 months ago
- Benchmark llm performance☆95Updated 8 months ago
- transparent proxy server on demand model swapping for llama.cpp (or any local OpenAPI compatible server)☆475Updated this week
- a Repository of Open-WebUI tools to use with your favourite LLMs☆175Updated this week
- Handy tool to measure the performance and efficiency of LLMs workloads.☆51Updated last month
- ☆154Updated this week
- Lightweight Inference server for OpenVINO☆142Updated this week
- Code execution utilities for Open WebUI & Ollama☆264Updated 4 months ago
- API up your Ollama Server.☆141Updated 3 months ago
- Review/Check GGUF files and estimate the memory usage and maximum tokens per second.☆135Updated 2 weeks ago
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆115Updated 10 months ago
- ☆83Updated 3 months ago
- automatically quant GGUF models☆164Updated this week
- ☆197Updated last week
- A simple to use Ollama autocompletion engine with options exposed and streaming functionality☆121Updated 5 months ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆71Updated 6 months ago
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆243Updated 3 weeks ago
- Optimized Ollama LLM server configuration for Mac Studio and other Apple Silicon Macs. Headless setup with automatic startup, resource op…☆149Updated 2 weeks ago
- Ollama client written in Python☆159Updated 3 months ago
- Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniqu…☆62Updated 7 months ago
- 🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.☆346Updated 3 months ago
- FastMLX is a high performance production ready API to host MLX models.☆281Updated last week
- Ollama chat client in Vue, everything you need to do your private text rpg in browser☆122Updated 5 months ago
- Free Search is a wrapper on top of publicly available SearXNG instances to give free internet access as a rest API.☆14Updated last week
- Link you Ollama models to LM-Studio☆132Updated 8 months ago
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆55Updated last month
- Turns devices into a scalable LLM platform☆127Updated this week
- Efficient visual programming for AI language models☆353Updated 6 months ago