aidatatools / ollama-benchmarkLinks
LLM Benchmark for Throughput via Ollama (Local LLMs)
☆269Updated last month
Alternatives and similar repositories for ollama-benchmark
Users that are interested in ollama-benchmark are comparing it to the libraries listed below
Sorting:
- A proxy server for multiple ollama instances with Key security☆470Updated last week
- beep boop 🤖 (experimental)☆112Updated 7 months ago
- Code execution utilities for Open WebUI & Ollama☆290Updated 8 months ago
- Lemonade helps users run local LLMs with the highest performance by configuring state-of-the-art inference engines for their NPUs and GPU…☆381Updated this week
- Download models from the Ollama library, without Ollama☆90Updated 8 months ago
- Handy tool to measure the performance and efficiency of LLMs workloads.☆69Updated 3 months ago
- OpenAPI Tool Servers☆573Updated last month
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆116Updated last year
- Link you Ollama models to LM-Studio☆141Updated last year
- 🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.☆390Updated 3 months ago
- VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.☆183Updated 6 months ago
- Benchmark llm performance☆101Updated last year
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆260Updated 5 months ago
- Fully-featured, beautiful web interface for vLLM - built with NextJS.☆149Updated 3 months ago
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆158Updated last year
- Nginx proxy server in a Docker container to Authenticate & Proxy requests to Ollama from Public Internet via Cloudflare Tunnel☆128Updated last month
- A fast batching API to serve LLM models☆185Updated last year
- Open‑WebUI Tools is a modular toolkit designed to extend and enrich your Open WebUI instance, turning it into a powerful AI workstation. …☆294Updated last week
- Lightweight Inference server for OpenVINO☆191Updated 2 weeks ago
- ☆207Updated 2 weeks ago
- This repository contains custom pipelines developed for the OpenWebUI framework, including advanced workflows such as long-term memory fi…☆71Updated 2 months ago
- A open webui function for better R1 experience☆79Updated 5 months ago
- Dolphin System Messages☆323Updated 5 months ago
- InferX is a Inference Function as a Service Platform☆119Updated 2 weeks ago
- This project demonstrates a basic chain-of-thought interaction with any LLM (Large Language Model)☆321Updated 10 months ago
- You don’t need to read the code to understand how to build!☆202Updated 6 months ago
- A platform to self-host AI on easy mode☆156Updated this week
- Official python implementation of the UTCP☆364Updated last week
- ☆95Updated 7 months ago
- Optimized Ollama LLM server configuration for Mac Studio and other Apple Silicon Macs. Headless setup with automatic startup, resource op…☆225Updated 5 months ago