This is a FastAPI based LLM server. Load multiple LLM models (MLX or llama.cpp) simultaneously using multiprocessing.
☆19Apr 8, 2026Updated 4 months ago
Alternatives and similar repositories for mlx_gguf_server
Users that are interested in mlx_gguf_server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Automatically post images from a subreddit to an instagram account.☆10Feb 24, 2022Updated 4 years ago
- Integrate Phone Calls and SMS with Open AI using the Vonage Voice and Messages APIs☆11Jul 12, 2026Updated last month
- An animated card menu built with SwiftUI☆10Apr 17, 2023Updated 3 years ago
- A simple demo for utilizing grounding dino and segment anything v2 models together☆21Jul 31, 2024Updated 2 years ago
- This is an Ai based Yoga Pose Detection System☆10Jul 5, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆12Sep 5, 2021Updated 4 years ago
- Application that allows you to monitor your stock price depending on the amount of RSU that you have from this company. App goes to check…☆12Jul 15, 2021Updated 5 years ago
- Astro SSG🚀 + Firebase🔥☆11Jan 10, 2024Updated 2 years ago
- A simple wrapper around "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching" that provides an OpenAI-compatibl…☆14Feb 7, 2025Updated last year
- Scripts and tools for optimizing quantizations in llama.cpp with GGUF imatrices.☆19Jan 10, 2025Updated last year
- 条件随机场（CRF）的pytorch实现☆10Mar 7, 2021Updated 5 years ago
- Examples in the MLX framework☆11Sep 23, 2024Updated last year
- ☆20Jun 25, 2026Updated 2 months ago
- separating music and voice from a song☆10Nov 29, 2018Updated 7 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A simple Restaurant Table booking app showing basic usage of Firebase realtime database☆11Apr 1, 2018Updated 8 years ago
- 山东省第二届数据应用创新创业大赛-主赛场-检验报告单识别-Baseline☆13Jan 15, 2021Updated 5 years ago
- Full stack data-science project☆12Jan 13, 2022Updated 4 years ago
- 4K database from AVT group of TU Ilmenau☆21Jan 12, 2026Updated 7 months ago
- ☆15Aug 19, 2023Updated 3 years ago
- Repository for the WACV 2024 paper "PsyMo: A Dataset for Estimating Self-Reported Psychological Traits from Gait"☆14Feb 22, 2024Updated 2 years ago
- Open source video parser for the ITU-T P.1204.3 model.☆22Jul 8, 2025Updated last year
- Social Media Marketing Service Tool website like smmpanel.net, built with REACT JS☆12Feb 24, 2024Updated 2 years ago
- 🍕 Food Ordering iOS application.☆18Mar 8, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Google meet bot deployed on Digital ocean join meetings from Google calendar and record audio+transcription.☆10Aug 4, 2021Updated 5 years ago
- Genius-SaaS: An AI-powered SaaS application built with Next.js and React for personalized recommendations, dynamic content generation, an…☆16Jul 30, 2023Updated 3 years ago
- 🖼️🤖 302 Vector Graphics Generation! 🚀✨☆20Aug 26, 2025Updated last year
- .NET SDK for Azure OpenAI platform☆15Feb 14, 2023Updated 3 years ago
- Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…☆22May 9, 2025Updated last year
- ☆18May 10, 2025Updated last year
- This is new python code editor for begginers with script run ability and with hot keys. And with Open AI GPT-4 (Llama 3.2) model assistan…☆20Mar 15, 2026Updated 5 months ago
- ☆18Dec 8, 2022Updated 3 years ago
- Simple Object Detection Application☆20Sep 17, 2023Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 💙 Unstructured Data Connectors for Haystack 2.0☆18Sep 21, 2023Updated 2 years ago
- A chatbot with IBM Voice Gateway which enables direct voice interactions over a telephone with an artificial intelligence (AI) selfservic…☆20Sep 16, 2019Updated 6 years ago
- Source code for ECCV 2022 paper: "MetaGait: Learning to Learn an Omni Sample Adaptive Representation for Gait Recognition"☆13Jul 19, 2022Updated 4 years ago
- AI SaaS Companion with Next.js 13, React, Tailwind, Prisma, Stripe, PlanetScale, Upstash, Pinecone & Replicate API.☆17Aug 30, 2024Updated 2 years ago
- ☆17Jan 10, 2026Updated 7 months ago
- Responsive Fried Chicken Website Using HTML CSS JavaScript☆19Jul 7, 2025Updated last year
- A clone of the Suno AI website UI using NextJS and Tailwind☆17May 27, 2024Updated 2 years ago