gitkaz / mlx_gguf_serverLinks
This is a FastAPI based LLM server. Load multiple LLM models (MLX or llama.cpp) simultaneously using multiprocessing.
☆14Updated last month
Alternatives and similar repositories for mlx_gguf_server
Users that are interested in mlx_gguf_server are comparing it to the libraries listed below
Sorting:
- A swarm of LLM agents that will help you test, document, and productionize your code!☆16Updated last week
- ☆14Updated last year
- AI Search engine☆12Updated last month
- Seamless Voice Interactions with LLMs☆12Updated 2 years ago
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16Updated 6 months ago
- ☆11Updated last year
- A python command-line tool to download & manage MLX AI models from Hugging Face.☆19Updated last year
- ☆27Updated last year
- A simple Flask app that lets you text back and forth with Open Interpreter. Probably a bad idea.☆21Updated 2 years ago
- A minimal Model Context Protocol 🖥️ server/client🧑💻with Azure OpenAI and 🌐 web browser control via Playwright.☆30Updated 7 months ago
- ☆32Updated last year
- AgentParse is a high-performance parsing library designed to map various structured data formats (such as Pydantic models, JSON, YAML, an…☆16Updated 3 weeks ago
- Your Python AI Coder!☆35Updated 5 months ago
- A QT GUI for large language models☆39Updated last year
- Example Optimizely clone created with GPT Pilot☆29Updated last year
- WhisperAnywhere: Effortless speech-to-text everywhere on your Mac. Use a hotkey to dictate in any app, powered by Whisper AI and Groq API…☆34Updated last year
- Easiest way to build custom agents, in a no-code notion style editor, using simple macros.☆35Updated last year
- 🌟EasyAGI : A generalist agent that can go online and accomplish complex tasks.☆28Updated last year
- A generalist agent that can go online and accomplish complex tasks using semantic-kernel and autogen.☆30Updated 3 months ago
- ☆32Updated this week
- Various agents from all of the top agent frameworks to integrate into swarms! Langchain, Griptape, CrewAI, and more!☆15Updated this week
- Task management for AI agents☆14Updated 4 months ago
- Simple GUI to load a PDF/Docx/txt file and have LM Studio Answer based off of it.☆14Updated last year
- Voice agent using LiveKit (orchestration), Cartesia (TTS), OpenAI (LLM), and Deepgram (STT)☆19Updated last week
- Claudetools is a Python library that enables function calling with the Claude 3 family of language models from Anthropic.☆38Updated 9 months ago
- 🧠 Mem4AI: A LLM Friendly memory management library.☆33Updated last year
- An LLM playground similar to the OpenAI API playground☆20Updated last year
- 🧠 Retrieval Augmented Generation (RAG) example☆18Updated 2 months ago
- Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.☆29Updated 7 months ago
- Median is an open-source flashcard application that leverages the power of spaced repetition and artificial intelligence to transform the…☆23Updated last year