This is a FastAPI based LLM server. Load multiple LLM models (MLX or llama.cpp) simultaneously using multiprocessing.
☆19Apr 8, 2026Updated 6 months ago
Alternatives and similar repositories for mlx_gguf_server
Users that are interested in mlx_gguf_server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A simple SwiftUI ViewModifier to add a card-like background to a View.☆11Oct 28, 2019Updated 7 years ago
- Demo app with Loguru logging, async middleware to generate X-request-Id. Works with Gunicorn or Uvicorn, and is safe to use with async/th…☆10Feb 2, 2022Updated 4 years ago
- Integrate Phone Calls and SMS with Open AI using the Vonage Voice and Messages APIs☆13Oct 15, 2026Updated 2 weeks ago
- An animated card menu built with SwiftUI☆10Apr 17, 2023Updated 3 years ago
- Entirely Local AI Voice Assistant - Created using LangChain, Ollama, Whisper, Speech Recognition, and Sapi5☆13Mar 25, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A simple demo for utilizing grounding dino and segment anything v2 models together☆22Jul 31, 2024Updated 2 years ago
- This is an Ai based Yoga Pose Detection System☆10Jul 5, 2022Updated 4 years ago
- Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.☆30Mar 15, 2025Updated last year
- A simple Restaurant Table booking app showing basic usage of Firebase realtime database☆11Apr 1, 2018Updated 8 years ago
- In this course you'll learn to use Gradio to create user-friendly apps with minimal code: Summarize text using a large language model, ge…☆15Nov 15, 2023Updated 2 years ago
- Safe-by-design USDC and x402 payment plugin for Hermes Agent☆14Mar 20, 2026Updated 7 months ago
- JSON containing the list of irregular verbs per language (work in progress)☆10Sep 22, 2020Updated 6 years ago
- ☆12Sep 5, 2021Updated 5 years ago
- Neural Nexus : A comprehensive AI model hub for uploading , sharing, selling, and deploying machine learning models. Features Secure auth…☆16Sep 30, 2026Updated last month
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- It is an affiliate marketing automation project. It is fully automated and written in Django.☆10Dec 17, 2023Updated 2 years ago
- A chatbot demo app using Huggingface inference API, React Native, Expo, and Redux Saga. Build for Android, iOS, and Web.☆13Dec 7, 2022Updated 3 years ago
- Application that allows you to monitor your stock price depending on the amount of RSU that you have from this company. App goes to check…☆12Jul 15, 2021Updated 5 years ago
- separating music and voice from a song☆10Nov 29, 2018Updated 7 years ago
- DeepDialogue: A Multi-Turn Emotionally-Rich Spoken Dialogue Dataset (code for SER Task)☆11May 28, 2025Updated last year
- The deep learning researcher's starter kit☆10May 23, 2025Updated last year
- ☆12Sep 26, 2024Updated 2 years ago
- ☆10Apr 30, 2025Updated last year
- A simple wrapper around "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching" that provides an OpenAI-compatibl…☆14Feb 7, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- LLMs 算法工程师面试资料整理：覆盖基础理论、常见面试问题等。愿这是大家迈向“美好生活”的直通车 🚆，祝每位同学都拿到心仪的 offer！欢迎提交 PR / Issue，一起协作开发与长期维护。☆15Oct 21, 2025Updated last year
- Add a Carousel to SwiftUI☆16Nov 7, 2021Updated 4 years ago
- Yolov8-visualizations☆11Mar 10, 2023Updated 3 years ago
- 限制问题区域显存 62906MiB / 65024MiB 支持驱动 610.57.04 ，修改显卡显示名称为NVIDIA Tesla A100☆13Aug 30, 2026Updated 2 months ago
- PyTorch Implementation of Attention Prompt Tuning: Parameter-Efficient Adaptation of Pre-Trained Models for Action Recognition☆15Mar 12, 2024Updated 2 years ago
- An open database of printer and filament profiles for various 3D printing slicers. Integrated directly with the SimplyPrint slicer, allow…☆16Updated this week
- implementation of a context graph?? we'll see☆11Dec 30, 2025Updated 10 months ago
- Swift implementation of OpenAI's GPT-3 api☆18Dec 30, 2020Updated 5 years ago
- A SwiftUI-based Music Player inspired by the popular website Suno AI, showcasing modern iOS app development techniques. This was just a p…☆15Nov 16, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Made with Coingecko API, this is a VERY simple python script that asks you the crypto, date and currency you want and then proceeds to gi…☆15Jun 24, 2022Updated 4 years ago
- 🍕 Food Ordering iOS application.☆18Mar 8, 2024Updated 2 years ago
- Handles everything related to working with instruction datasets☆11Dec 19, 2023Updated 2 years ago
- Genius-SaaS: An AI-powered SaaS application built with Next.js and React for personalized recommendations, dynamic content generation, an…☆16Jul 30, 2023Updated 3 years ago
- Repository for the WACV 2024 paper "PsyMo: A Dataset for Estimating Self-Reported Psychological Traits from Gait"☆14Feb 22, 2024Updated 2 years ago
- Supertonic 2/3 embeddings (json) trainer with gradio UI☆16May 26, 2026Updated 5 months ago
- Efficient distance analysis for segmentation in PyTorch☆12Jun 20, 2026Updated 4 months ago