gitkaz / mlx_gguf_serverLinks
This is a FastAPI based LLM server. Load multiple LLM models (MLX or llama.cpp) simultaneously using multiprocessing.
☆15Updated last month
Alternatives and similar repositories for mlx_gguf_server
Users that are interested in mlx_gguf_server are comparing it to the libraries listed below
Sorting:
- A swarm of LLM agents that will help you test, document, and productionize your code!☆16Updated last week
- Snag web pages like a polite robot with a browser☆25Updated 2 weeks ago
- AI Search engine☆12Updated 4 months ago
- AI Agent capable of automating various tasks using MCP☆40Updated 9 months ago
- Galleries for Models, Datasets, and Plugins used by Transformer Lab☆27Updated last week
- Gradio chat interface for FastMLX☆12Updated last year
- Test your local LLMs on the AIME problems☆31Updated 7 months ago
- 🧠 Mem4AI: A LLM Friendly memory management library.☆34Updated last year
- Curated resources about automated GUI computer-use via LLMs. Highly opinionated, focus is on quality vs quantity.☆23Updated last week
- ☆17Updated last year
- Web Interface for Vision Language Models Including InternVLM2☆25Updated last year
- Ready-to-use agent that can interact directly with any tool or native endpoint, in less than 5 lines of code☆43Updated 3 months ago
- A proxy for minimax-m2, enabling interleaved thinking, and tool calls.☆38Updated 2 months ago
- A generalist agent that can go online and accomplish complex tasks using semantic-kernel and autogen.☆31Updated 6 months ago
- A python command-line tool to download & manage MLX AI models from Hugging Face.☆19Updated last year
- Multi-threading, Concurrency, Asynchrony, and various Execution Methods implemented in a Rust backend for bleeding edge performance.☆17Updated last year
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16Updated 8 months ago
- TLS & API keys for your LLM APIs☆19Updated last month
- Codebase exploration with AI research agents☆19Updated 11 months ago
- Run GEPA on your favorite non-python libraries.☆32Updated last week
- Easiest way to build custom agents, in a no-code notion style editor, using simple macros.☆34Updated last year
- ☆34Updated last year
- A Model Context Protocol server for Python code analysis with Claude. Again, works with warning now. I'm missing something here.☆12Updated 2 months ago
- Project-agnostic, composable configuration system for AI-assisted development workflows. Single source of truth for agentic tools (Claude…☆21Updated this week
- Use GPTparser with your OpenAI API to scrape & parse files into structured JSON files.☆13Updated last year
- Local first human friendly agents toolkit for the browser and Nodejs☆45Updated this week
- 🌟EasyAGI : A generalist agent that can go online and accomplish complex tasks.☆29Updated 2 years ago
- A QT GUI for large language models☆39Updated 2 years ago
- A set of tools to create synthetically-generated data from documents☆39Updated 5 months ago
- An advanced distributed knowledge fabric for intelligent document processing, featuring multi-document agents, optimized query handling, …☆49Updated 2 months ago