gitkaz / mlx_gguf_serverLinks
This is a FastAPI based LLM server. Load multiple LLM models (MLX or llama.cpp) simultaneously using multiprocessing.
☆14Updated 2 weeks ago
Alternatives and similar repositories for mlx_gguf_server
Users that are interested in mlx_gguf_server are comparing it to the libraries listed below
Sorting:
- A swarm of LLM agents that will help you test, document, and productionize your code!☆16Updated 2 weeks ago
- A simple Flask app that lets you text back and forth with Open Interpreter. Probably a bad idea.☆22Updated 2 years ago
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16Updated 8 months ago
- Claudetools is a Python library that enables function calling with the Claude 3 family of language models from Anthropic.☆38Updated 11 months ago
- 🧠 Mem4AI: A LLM Friendly memory management library.☆33Updated last year
- Centralized, versioned configuration for AI-assisted development workflows. Single source of truth for agentic tools (Claude Code, Antigr…☆17Updated this week
- Simple GUI to load a PDF/Docx/txt file and have LM Studio Answer based off of it.☆14Updated last year
- ☆14Updated last year
- AI Search engine☆12Updated 3 months ago
- 🌟EasyAGI : A generalist agent that can go online and accomplish complex tasks.☆28Updated 2 years ago
- MCP Server implementation for Claude☆26Updated last year
- Tool4AI: A model agnostic, LLM friendly router for tool/function call☆19Updated last year
- A generalist agent that can go online and accomplish complex tasks using semantic-kernel and autogen.☆31Updated 5 months ago
- AI Agent capable of automating various tasks using MCP☆40Updated 9 months ago
- Simple Chainlit UI for running llms from Groq and LangChain☆17Updated last year
- A python command-line tool to download & manage MLX AI models from Hugging Face.☆19Updated last year
- A minimal Model Context Protocol 🖥️ server/client🧑💻with Azure OpenAI and 🌐 web browser control via Playwright.☆31Updated 9 months ago
- Autonomous agent networks for task automation that requires multi-step reasoning☆29Updated 4 months ago
- watch your screen while doing sales and fill your crm automatically☆17Updated last year
- An open source framework for Retrieval-Augmented System (RAG) uses semantic search helps to retrieve the expected results and generate h…☆22Updated last month
- Snag web pages like a polite robot with a browser☆22Updated last month
- Setup an MCP server in 60 seconds.☆13Updated last year
- WhisperAnywhere: Effortless speech-to-text everywhere on your Mac. Use a hotkey to dictate in any app, powered by Whisper AI and Groq API…☆34Updated last year
- ☆34Updated last year
- Median is an open-source flashcard application that leverages the power of spaced repetition and artificial intelligence to transform the…☆22Updated last year
- Shared personal notes created while working with the Apple MLX machine learning framework☆24Updated 3 weeks ago
- Exploring what's possible with the ChatGPT Code Interpreter and how to use it effectively☆11Updated 2 years ago
- Web Interface for Vision Language Models Including InternVLM2☆25Updated last year
- A quick Crew AI tutorial☆23Updated last year
- ☆11Updated last year