This is a FastAPI based LLM server. Load multiple LLM models (MLX or llama.cpp) simultaneously using multiprocessing.
☆17Apr 8, 2026Updated 2 months ago
Alternatives and similar repositories for mlx_gguf_server
Users that are interested in mlx_gguf_server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ChatGPT Example - How to integrate ChatGPT into web platform☆10Feb 18, 2025Updated last year
- A minimal Django starter template with Tailwind CSS and DaisyUI components, featuring a light/dark theme toggle and a custom user model. …☆20Jul 20, 2025Updated 10 months ago
- A TensorFlow 2 Keras implementation of TabNets.☆13Feb 21, 2022Updated 4 years ago
- Automatically post images from a subreddit to an instagram account.☆10Feb 24, 2022Updated 4 years ago
- an online variant of AVrateNG☆16Mar 20, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Neoforged 事件列表的中文翻译☆19Feb 6, 2025Updated last year
- Vuejs tutorial☆14Apr 16, 2018Updated 8 years ago
- Test your local LLMs on the AIME problems☆39Jun 7, 2025Updated last year
- A better way to install NerdFonts on Termux☆23Mar 30, 2024Updated 2 years ago
- A simple SwiftUI ViewModifier to add a card-like background to a View.☆11Oct 28, 2019Updated 6 years ago
- Graph neural networks (GNNs) is implemented with Cora datset using Spektral module.☆13Nov 12, 2020Updated 5 years ago
- Code for paper "A method for detecting causal relationships between industrial alarm variables using Transfer entropy and K2-Algorithm"☆17Aug 3, 2022Updated 3 years ago
- This project is the backend engine for a fully autonomous AI-powered call center. It integrates a large language model (LLM), speech reco…☆23Apr 18, 2025Updated last year
- ☆29Jul 4, 2025Updated 11 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Accelerating GOT-OCRv2 with VLLM☆10Nov 15, 2024Updated last year
- Demo app with Loguru logging, async middleware to generate X-request-Id. Works with Gunicorn or Uvicorn, and is safe to use with async/th…☆10Feb 2, 2022Updated 4 years ago
- Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.☆29Mar 15, 2025Updated last year
- An animated card menu built with SwiftUI☆10Apr 17, 2023Updated 3 years ago
- Integrate Phone Calls and SMS with Open AI using the Vonage Voice and Messages APIs☆11May 29, 2026Updated last week
- A codex planning mode enhancing skill，works better than codex planning mode.☆113Apr 25, 2026Updated last month
- ☆25Aug 29, 2025Updated 9 months ago
- separating music and voice from a song☆10Nov 29, 2018Updated 7 years ago
- Pure python Matroska / EBML parser☆16Jun 30, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆24May 26, 2025Updated last year
- ☆13Jul 29, 2025Updated 10 months ago
- 条件随机场（CRF）的pytorch实现☆10Mar 7, 2021Updated 5 years ago
- ☆12Sep 5, 2021Updated 4 years ago
- Application that allows you to monitor your stock price depending on the amount of RSU that you have from this company. App goes to check…☆11Jul 15, 2021Updated 4 years ago
- A basic implementation of the UPGMA (Unweighted Pair Group Method with Arithmetic Mean) clustering algorithm in Python.☆13Dec 11, 2015Updated 10 years ago
- Astro SSG🚀 + Firebase🔥☆11Jan 10, 2024Updated 2 years ago
- A simple wrapper around "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching" that provides an OpenAI-compatibl…☆14Feb 7, 2025Updated last year
- iOS App Demo To Generate swift code using OpenAI & ChatGPT☆13Dec 19, 2022Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A chatbot demo app using Huggingface inference API, React Native, Expo, and Redux Saga. Build for Android, iOS, and Web.☆13Dec 7, 2022Updated 3 years ago
- Google's Dinosaur game implementation in URL bar 🦕☆51May 3, 2026Updated last month
- LiteLoaderBDSv2 bindings for .NET (Obsoleted)☆25Oct 13, 2023Updated 2 years ago
- 100行解决中文模糊实体识别with字典树和编辑距离 Chinese fuzzy entity matching with prefix tree and distance editing☆11Sep 25, 2023Updated 2 years ago
- A clone of the Suno AI website UI using NextJS and Tailwind☆15May 27, 2024Updated 2 years ago
- ☆10Apr 30, 2025Updated last year
- A SwiftUI-based Music Player inspired by the popular website Suno AI, showcasing modern iOS app development techniques. This was just a p…☆15Nov 16, 2024Updated last year