This is a FastAPI based LLM server. Load multiple LLM models (MLX or llama.cpp) simultaneously using multiprocessing.
☆17Mar 8, 2026Updated 2 weeks ago
Alternatives and similar repositories for mlx_gguf_server
Users that are interested in mlx_gguf_server are comparing it to the libraries listed below
Sorting:
- ChatGPT Example - How to integrate ChatGPT into web platform☆11Feb 18, 2025Updated last year
- A swarm of LLM agents that will help you test, document, and productionize your code!☆16Feb 16, 2026Updated last month
- A minimal Django starter template with Tailwind CSS and DaisyUI components, featuring a light/dark theme toggle and a custom user model. …☆20Jul 20, 2025Updated 8 months ago
- A TensorFlow 2 Keras implementation of TabNets.☆13Feb 21, 2022Updated 4 years ago
- Gradio chat interface for FastMLX☆12Sep 22, 2024Updated last year
- Automatically post images from a subreddit to an instagram account.☆10Feb 24, 2022Updated 4 years ago
- an online variant of AVrateNG☆15Mar 20, 2025Updated last year
- Neoforged 事件列表的中文翻译☆20Feb 6, 2025Updated last year
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16May 8, 2025Updated 10 months ago
- Test your local LLMs on the AIME problems☆32Jun 7, 2025Updated 9 months ago
- Vuejs tutorial☆14Apr 16, 2018Updated 7 years ago
- A better way to install NerdFonts on Termux☆21Mar 30, 2024Updated last year
- A simple SwiftUI ViewModifier to add a card-like background to a View.☆11Oct 28, 2019Updated 6 years ago
- Graph neural networks (GNNs) is implemented with Cora datset using Spektral module.☆13Nov 12, 2020Updated 5 years ago
- Google's Dinosaur game implementation in URL bar 🦕☆14Jun 4, 2020Updated 5 years ago
- Code for paper "A method for detecting causal relationships between industrial alarm variables using Transfer entropy and K2-Algorithm"☆17Aug 3, 2022Updated 3 years ago
- This project is the backend engine for a fully autonomous AI-powered call center. It integrates a large language model (LLM), speech reco…☆21Apr 18, 2025Updated 11 months ago
- ☆28Jul 4, 2025Updated 8 months ago
- Accelerating GOT-OCRv2 with VLLM☆11Nov 15, 2024Updated last year
- Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.☆29Mar 15, 2025Updated last year
- Demo app with Loguru logging, async middleware to generate X-request-Id. Works with Gunicorn or Uvicorn, and is safe to use with async/th…☆10Feb 2, 2022Updated 4 years ago
- An animated card menu built with SwiftUI☆10Apr 17, 2023Updated 2 years ago
- Multi-instance split-pane manager for Claude Code — a cross-platform desktop app built with Tauri 2☆61Updated this week
- A proxy for minimax-m2, enabling interleaved thinking, and tool calls.☆40Nov 21, 2025Updated 4 months ago
- Integrate Phone Calls and SMS with Open AI using the Vonage Voice and Messages APIs☆11Feb 11, 2026Updated last month
- separating music and voice from a song☆10Nov 29, 2018Updated 7 years ago
- ☆25May 26, 2025Updated 9 months ago
- ☆25Aug 29, 2025Updated 6 months ago
- Pure python Matroska / EBML parser☆16Jun 30, 2022Updated 3 years ago
- ☆13Jul 29, 2025Updated 7 months ago
- GGUF Loader with its Agentic Mode, and floating button, ai Models | Open Source & Offline. Mistral, Deepseek, llama, gemma, qwen☆31Feb 11, 2026Updated last month
- ☆12Sep 5, 2021Updated 4 years ago
- Application that allows you to monitor your stock price depending on the amount of RSU that you have from this company. App goes to check…☆11Jul 15, 2021Updated 4 years ago
- 条件随机场（CRF）的pytorch实现☆10Mar 7, 2021Updated 5 years ago
- A basic implementation of the UPGMA (Unweighted Pair Group Method with Arithmetic Mean) clustering algorithm in Python.☆13Dec 11, 2015Updated 10 years ago
- Astro SSG🚀 + Firebase🔥☆11Jan 10, 2024Updated 2 years ago
- A simple wrapper around "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching" that provides an OpenAI-compatibl…☆14Feb 7, 2025Updated last year
- iOS App Demo To Generate swift code using OpenAI & ChatGPT☆13Dec 19, 2022Updated 3 years ago
- A chatbot demo app using Huggingface inference API, React Native, Expo, and Redux Saga. Build for Android, iOS, and Web.☆13Dec 7, 2022Updated 3 years ago