gitkaz / mlx_gguf_serverLinks
This is a FastAPI based LLM server. Load multiple LLM models (MLX or llama.cpp) simultaneously using multiprocessing.
☆14Updated last week
Alternatives and similar repositories for mlx_gguf_server
Users that are interested in mlx_gguf_server are comparing it to the libraries listed below
Sorting:
- A swarm of LLM agents that will help you test, document, and productionize your code!☆17Updated this week
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16Updated 6 months ago
- ☆14Updated last year
- Example Optimizely clone created with GPT Pilot☆29Updated last year
- Claudetools is a Python library that enables function calling with the Claude 3 family of language models from Anthropic.☆38Updated 10 months ago
- A simple Flask app that lets you text back and forth with Open Interpreter. Probably a bad idea.☆22Updated 2 years ago
- Simple GUI to load a PDF/Docx/txt file and have LM Studio Answer based off of it.☆14Updated last year
- AI Search engine☆12Updated 2 months ago
- A minimal Model Context Protocol 🖥️ server/client🧑💻with Azure OpenAI and 🌐 web browser control via Playwright.☆31Updated 7 months ago
- A QT GUI for large language models☆38Updated last year
- ☆27Updated last year
- WhisperAnywhere: Effortless speech-to-text everywhere on your Mac. Use a hotkey to dictate in any app, powered by Whisper AI and Groq API…☆34Updated last year
- ☆32Updated last year
- ☆11Updated last year
- WebSage is an AI Engine that extracts content from any URL, generates summaries, and enables interaction using AI models. Choose between …☆16Updated 9 months ago
- Text with Open Interpreter, running locally on your Mac. Credit: Morisy☆23Updated 2 years ago
- A generalist agent that can go online and accomplish complex tasks using semantic-kernel and autogen.☆30Updated 4 months ago
- Snag web pages like a polite robot with a browser☆18Updated 3 weeks ago
- 🧠 Mem4AI: A LLM Friendly memory management library.☆33Updated last year
- Gradio chat interface for FastMLX☆12Updated last year
- An LLM playground similar to the OpenAI API playground☆21Updated last year
- ☆21Updated last year
- A quick Crew AI tutorial☆23Updated last year
- AI Agent capable of automating various tasks using MCP☆40Updated 7 months ago
- Median is an open-source flashcard application that leverages the power of spaced repetition and artificial intelligence to transform the…☆23Updated last year
- Radiantloom Email Assist 7B is an email-assistant large language model fine-tuned from Zephyr-7B-Beta, over a custom-curated dataset of 1…☆14Updated last year
- Voice agent using LiveKit (orchestration), Cartesia (TTS), OpenAI (LLM), and Deepgram (STT)☆20Updated last month
- ☆32Updated 3 weeks ago
- 🌟EasyAGI : A generalist agent that can go online and accomplish complex tasks.☆28Updated last year
- Your Python AI Coder!☆35Updated 6 months ago