cnrai / llm-perfbench
☆12Updated last month
Alternatives and similar repositories for llm-perfbench
Users that are interested in llm-perfbench are comparing it to the libraries listed below
Sorting:
- OllamaLab: a fully fledged AI assistant utilizing Ollama with Companion Mode for MacOS☆34Updated 8 months ago
- Llama.cpp runner/swapper and proxy that emulates LMStudio / Ollama backends☆16Updated this week
- ☆19Updated 8 months ago
- A Python package enabling LLM models to interact with the Memos server via the MCP interface for searching, creating, retrieving, and man…☆13Updated 2 months ago
- No longer actively being worked on, Please use https://github.com/open-webui/extension instead☆28Updated last year
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆115Updated 11 months ago
- OpenWebUISimpleDesktop made by Attila Barkoczi.☆29Updated 3 weeks ago
- A wannabe Ollama equivalent for Apple MlX models☆67Updated 2 months ago
- Fill up the `model_list` field in your LiteLLM proxy configuration file☆10Updated 8 months ago
- 👁️ Multimodal LLM vision multitool☆26Updated 7 months ago
- This repo periodically pulls from the upstream Perplexica repo and pushes docker images to docker hub. For installation details check th…☆28Updated this week
- LLM based file organizer☆26Updated 2 years ago
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆81Updated 5 months ago
- Blazing fast whisper turbo for ASR (speech-to-text) tasks☆207Updated 6 months ago
- Chat with your pdf using your local LLM, OLLAMA client.(incomplete)☆37Updated 7 months ago
- Mocking OpenAI API through ChatGPT Desktop app☆158Updated last week
- Optimized Ollama LLM server configuration for Mac Studio and other Apple Silicon Macs. Headless setup with automatic startup, resource op…☆180Updated 2 months ago
- MCP for reddit☆16Updated last month
- ☆69Updated this week
- Publish local LLMs and LLM apps on the internet.☆24Updated 9 months ago
- Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma☆34Updated 7 months ago
- Accessible Python client to debug and interact with screenpipe.☆20Updated 4 months ago
- A third-party package manager for OpenWebUI☆30Updated 10 months ago
- Web UI and API for managing MCP Orchestrator (mcpo) instances and configurations☆30Updated this week
- Generate and execute command line commands using LLM☆47Updated 3 months ago
- Wrapper for handling perplexity ai chat model in Langchain projects.☆10Updated last year
- aicodeprep is a command-line tool designed to simplify the process of sharing your project's code with AI chatbots.☆23Updated 3 months ago
- Demo app for Groq plugins in LiveKit Agents☆48Updated last month
- macOS whisper dictation app☆148Updated last month
- Local LLM Messenger (lollmm) is a way to send iMessages to the AI that runs in your computer.☆29Updated last year