This is a FastAPI based LLM server. Load multiple LLM models (MLX or llama.cpp) simultaneously using multiprocessing.
☆18Apr 8, 2026Updated 3 months ago
Alternatives and similar repositories for mlx_gguf_server
Users that are interested in mlx_gguf_server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Automatically post images from a subreddit to an instagram account.☆10Feb 24, 2022Updated 4 years ago
- A simple SwiftUI ViewModifier to add a card-like background to a View.☆11Oct 28, 2019Updated 6 years ago
- Integrate Phone Calls and SMS with Open AI using the Vonage Voice and Messages APIs☆11Jul 12, 2026Updated last week
- Automates the creation of full-text (sound and text) ebooks in epub/epub3/daisy format, the webserver/client creates smil files to sync a…☆10Nov 12, 2021Updated 4 years ago
- Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.☆29Mar 15, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- An animated card menu built with SwiftUI☆10Apr 17, 2023Updated 3 years ago
- an online variant of AVrateNG☆16Mar 20, 2025Updated last year
- This is an Ai based Yoga Pose Detection System☆10Jul 5, 2022Updated 4 years ago
- Application that allows you to monitor your stock price depending on the amount of RSU that you have from this company. App goes to check…☆12Jul 15, 2021Updated 5 years ago
- Astro SSG🚀 + Firebase🔥☆11Jan 10, 2024Updated 2 years ago
- "Tail-Aware Sperm Analysis for Transparent Tracking of Spermatozoa" Official Implementation☆10Jan 21, 2026Updated 6 months ago
- A chatbot demo app using Huggingface inference API, React Native, Expo, and Redux Saga. Build for Android, iOS, and Web.☆12Dec 7, 2022Updated 3 years ago
- separating music and voice from a song☆10Nov 29, 2018Updated 7 years ago
- 4K database from AVT group of TU Ilmenau☆21Jan 12, 2026Updated 6 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Repository for the WACV 2024 paper "PsyMo: A Dataset for Estimating Self-Reported Psychological Traits from Gait"☆14Feb 22, 2024Updated 2 years ago
- AI SaaS Companion with Next.js 13, React, Tailwind, Prisma, Stripe, PlanetScale, Upstash, Pinecone & Replicate API.☆17Aug 30, 2024Updated last year
- Open source video parser for the ITU-T P.1204.3 model.☆22Jul 8, 2025Updated last year
- Muse 2/S EEG Headset Vanilla Javascript Library☆12Jun 24, 2022Updated 4 years ago
- Code release for the CVPR 2023 paper "Discriminative Co-Saliency and BG Mining Transformer for Co-Salient Object Detection" by Long Li, J…☆21Sep 14, 2024Updated last year
- Social Media Marketing Service Tool website like smmpanel.net, built with REACT JS☆12Feb 24, 2024Updated 2 years ago
- 🍕 Food Ordering iOS application.☆18Mar 8, 2024Updated 2 years ago
- Google meet bot deployed on Digital ocean join meetings from Google calendar and record audio+transcription.☆10Aug 4, 2021Updated 4 years ago
- Genius-SaaS: An AI-powered SaaS application built with Next.js and React for personalized recommendations, dynamic content generation, an…☆16Jul 30, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 基于deepseek、qwen3大模型，lora sft 医疗行业数据☆15Apr 10, 2026Updated 3 months ago
- Local DeepSearch (Advantage: Low Threshold): an implementation of Agentic RAG based on DeepSeek-R1 API and Tavily API☆17Jun 21, 2025Updated last year
- .NET SDK for Azure OpenAI platform☆15Feb 14, 2023Updated 3 years ago
- Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…☆22May 9, 2025Updated last year
- Swift implementation of OpenAI's GPT-3 api☆18Dec 30, 2020Updated 5 years ago
- ☆17May 10, 2025Updated last year
- This is new python code editor for begginers with script run ability and with hot keys. And with Open AI GPT-4 (Llama 3.2) model assistan…☆20Mar 15, 2026Updated 4 months ago
- A multiple-metric framework for video quality assessment over IP networks☆30May 18, 2019Updated 7 years ago
- ☆18Dec 8, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Simple Object Detection Application☆20Sep 17, 2023Updated 2 years ago
- 💙 Unstructured Data Connectors for Haystack 2.0☆18Sep 21, 2023Updated 2 years ago
- Source code for ECCV 2022 paper: "MetaGait: Learning to Learn an Omni Sample Adaptive Representation for Gait Recognition"☆13Jul 19, 2022Updated 4 years ago
- ☆16Jan 10, 2026Updated 6 months ago
- Waffer-thin FlaskGPT on Vercel.☆12Jun 1, 2023Updated 3 years ago
- This project implements a Hybrid Retrieval-Augmented Generation (RAG) approach with knowledge graphs for interacting with PDF documents. …☆13Oct 12, 2025Updated 9 months ago
- 💧 Monitoring water tanker level using NodeMCU ESP8266 and HC-SR04P Ultrasonic Sensor and broadcasting it using a simple HTTP server insi…☆21Oct 1, 2022Updated 3 years ago