itsmostafa / inference-speed-testsLinks
Local LLM inference speed tests on various devices
☆89Updated 4 months ago
Alternatives and similar repositories for inference-speed-tests
Users that are interested in inference-speed-tests are comparing it to the libraries listed below
Sorting:
- Optimized Ollama LLM server configuration for Mac Studio and other Apple Silicon Macs. Headless setup with automatic startup, resource op…☆244Updated 5 months ago
- Your gateway to both Ollama & Apple MlX models☆142Updated 5 months ago
- AI agent that controls computer with OS-level tools, MCP compatible, works with any model☆99Updated 4 months ago
- A macOS AppleScript MCP server☆284Updated 3 months ago
- A wannabe Ollama equivalent for Apple MlX models☆77Updated 5 months ago
- MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. I…☆508Updated this week
- High-performance MLX-based LLM inference engine for macOS with native Swift implementation☆383Updated last week
- This is a cross-platform desktop application that allows you to chat with locally hosted LLMs and enjoy features like MCP support☆221Updated this week
- Ollama client for iOS, Android, macOS, and Windows that simplifies experimenting with LLMs.☆193Updated 5 months ago
- Accessing Apple Intelligence and ChatGPT desktop through OpenAI / Ollama API☆268Updated 2 weeks ago
- Shell and coding agent on claude desktop app☆558Updated 3 weeks ago
- Local Apple Notes + LLM Chat☆86Updated 5 months ago
- MCP server that execute applescript giving you full control of your Mac☆341Updated 2 months ago
- a magical LLM desktop client that makes it easy for *anyone* to use LLMs and MCP☆414Updated this week
- An MCP server that securely interfaces with your iMessage database via the Model Context Protocol (MCP), allowing LLMs to query and analy…☆157Updated last month
- Welcome!☆140Updated 8 months ago
- Local image and music generation for Apple Silicon☆60Updated 4 months ago
- Open‑WebUI Tools is a modular toolkit designed to extend and enrich your Open WebUI instance, turning it into a powerful AI workstation. …☆312Updated last week
- macOS whisper dictation app☆350Updated this week
- ☆219Updated 3 months ago
- The only general AI agent that does NOT requires extra API key, giving you full control on your local and remote MacOs from Claude Deskto…☆296Updated 2 months ago
- Artificial Neural Engine Machine Learning Library☆1,128Updated 3 weeks ago
- MacOS menu‑bar utility to adjust Apple Silicon GPU VRAM allocation☆216Updated 3 months ago
- An implementation of the Nvidia's Parakeet models for Apple Silicon using MLX.☆414Updated last month
- A cross patform app that unlocks your devices Gen AI capabilities☆63Updated last month
- Link you Ollama models to LM-Studio☆142Updated last year
- A native desktop app for Open WebUI built with Tauri v2☆65Updated 4 months ago
- ☆120Updated last week
- Use locally running LLMs directly from Siri 🦙🟣☆180Updated 10 months ago
- CoexistAI is a modular, developer-friendly research assistant framework . It enables you to build, search, summarize, and automate resear…☆190Updated last week