itsmostafa / inference-speed-testsLinks
Local LLM inference speed tests on various devices
☆110Updated 9 months ago
Alternatives and similar repositories for inference-speed-tests
Users that are interested in inference-speed-tests are comparing it to the libraries listed below
Sorting:
- Your gateway to both Ollama & Apple MlX models☆150Updated 10 months ago
- Optimized Ollama LLM server configuration for Mac Studio and other Apple Silicon Macs. Headless setup with automatic startup, resource op…☆273Updated 9 months ago
- AI agent that controls computer with OS-level tools, MCP compatible, works with any model☆124Updated 4 months ago
- A wannabe Ollama equivalent for Apple MlX models☆81Updated 10 months ago
- MacOS menu‑bar utility to adjust Apple Silicon GPU VRAM allocation☆243Updated 8 months ago
- High-performance MLX-based LLM inference engine for macOS with native Swift implementation☆456Updated last week
- MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. I…☆631Updated 2 weeks ago
- Accessing Apple Intelligence and ChatGPT desktop through OpenAI / Ollama API☆329Updated 4 months ago
- MCP server that execute applescript giving you full control of your Mac☆394Updated last month
- Local Apple Notes + LLM Chat☆97Updated 3 weeks ago
- A macOS AppleScript MCP server☆339Updated 8 months ago
- MLX-GUI MLX Inference Server for Apple Silicone☆161Updated 3 weeks ago
- CoexistAI is a modular, developer-friendly research assistant framework . It enables you to build, search, summarize, and automate resear…☆389Updated 2 months ago
- A multi-agent AI architecture that connects 25+ specialized agents through n8n and MCP servers. Project NOVA routes requests to domain-sp…☆253Updated 6 months ago
- Parse files (e.g. code repos) and websites to clipboard or a file for ingestions by AI / LLMs☆353Updated last month
- macOS whisper dictation app☆539Updated this week
- Tool for scraping and consolidating documentation websites into a single MD file.☆243Updated 2 weeks ago
- Qwen Image models through MPS☆249Updated last week
- A native desktop app for Open WebUI built with Tauri v2☆80Updated 8 months ago
- Welcome!☆141Updated last year
- A beautiful local-first coding agent running in your terminal - built by the community for the community ⚒☆1,107Updated this week
- The only general AI agent that does NOT requires extra API key, giving you full control on your local and remote MacOs from Claude Deskto…☆437Updated 6 months ago
- An MCP server that securely interfaces with your iMessage database via the Model Context Protocol (MCP), allowing LLMs to query and analy…☆211Updated 3 months ago
- Link you Ollama models to LM-Studio☆150Updated last year
- This project was generated 100% by AI, with one prompt. NOTE: This neuroca project was generated in 3 hours on 3/3/2025. There are depend…☆47Updated 9 months ago
- This is a cross-platform desktop application that allows you to chat with locally hosted LLMs and enjoy features like MCP support☆226Updated 4 months ago
- Support for MLX models in LLM☆228Updated 8 months ago
- This is a simple headless project management system that helps coordinate several instances of LLM coders that work on the same project.☆299Updated 2 months ago
- 'afm' command cli: macOS server and single prompt mode that exposes Apple's Foundation Models through OpenAI-compatible API endpoints. Su…☆77Updated 2 months ago
- Copy Entire Folder to ChatGPT. Hit on Star to BookMark this Page ! Newer Release will be even Better.☆146Updated 9 months ago