This is a FastAPI based LLM server. Load multiple LLM models (MLX or llama.cpp) simultaneously using multiprocessing.
☆19Apr 8, 2026Updated 5 months ago
Alternatives and similar repositories for mlx_gguf_server
Users that are interested in mlx_gguf_server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Automatically post images from a subreddit to an instagram account.☆10Feb 24, 2022Updated 4 years ago
- A simple SwiftUI ViewModifier to add a card-like background to a View.☆11Oct 28, 2019Updated 6 years ago
- Integrate Phone Calls and SMS with Open AI using the Vonage Voice and Messages APIs☆11Jul 12, 2026Updated 2 months ago
- Demo app with Loguru logging, async middleware to generate X-request-Id. Works with Gunicorn or Uvicorn, and is safe to use with async/th…☆10Feb 2, 2022Updated 4 years ago
- Accelerating GOT-OCRv2 with VLLM☆10Nov 15, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- An animated card menu built with SwiftUI☆10Apr 17, 2023Updated 3 years ago
- an online variant of AVrateNG☆17Mar 20, 2025Updated last year
- ITU-T Rec. P.1203 Codec Extension to VP9 and HEVC☆15Mar 16, 2020Updated 6 years ago
- Application that allows you to monitor your stock price depending on the amount of RSU that you have from this company. App goes to check…☆12Jul 15, 2021Updated 5 years ago
- A simple wrapper around "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching" that provides an OpenAI-compatibl…☆14Feb 7, 2025Updated last year
- Scripts and tools for optimizing quantizations in llama.cpp with GGUF imatrices.☆19Jan 10, 2025Updated last year
- 条件随机场（CRF）的pytorch实现☆10Mar 7, 2021Updated 5 years ago
- A chatbot demo app using Huggingface inference API, React Native, Expo, and Redux Saga. Build for Android, iOS, and Web.☆13Dec 7, 2022Updated 3 years ago
- ☆10Apr 30, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 100行解决中文模糊实体识别with字典树和编辑距离 Chinese fuzzy entity matching with prefix tree and distance editing☆11Sep 25, 2023Updated 2 years ago
- A simple Restaurant Table booking app showing basic usage of Firebase realtime database☆11Apr 1, 2018Updated 8 years ago
- 山东省第二届数据应用创新创业大赛-主赛场-检验报告单识 别-Baseline☆13Jan 15, 2021Updated 5 years ago
- Full stack data-science project☆12Jan 13, 2022Updated 4 years ago
- 4K database from AVT group of TU Ilmenau☆21Jan 12, 2026Updated 8 months ago
- ☆15Aug 19, 2023Updated 3 years ago
- Open source video parser for the ITU-T P.1204.3 model.☆22Jul 8, 2025Updated last year
- 🍕 Food Ordering iOS application.☆18Mar 8, 2024Updated 2 years ago
- Genius-SaaS: An AI-powered SaaS application built with Next.js and React for personalized recommendations, dynamic content generation, an…☆16Jul 30, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Swift implementation of OpenAI's GPT-3 api☆18Dec 30, 2020Updated 5 years ago
- ☆18May 10, 2025Updated last year
- A multiple-metric framework for video quality assessment over IP networks☆30May 18, 2019Updated 7 years ago
- ☆18Dec 8, 2022Updated 3 years ago
- Personalized Virtual Webcam for WebRTC☆19Aug 5, 2026Updated last month
- Simple Object Detection Application☆20Sep 17, 2023Updated 3 years ago
- A chatbot with IBM Voice Gateway which enables direct voice interactions over a telephone with an artificial intelligence (AI) selfservic…☆20Sep 16, 2019Updated 7 years ago
- 💙 Unstructured Data Connectors for Haystack 2.0☆18Sep 21, 2023Updated 2 years ago
- AI SaaS Companion with Next.js 13, React, Tailwind, Prisma, Stripe, PlanetScale, Upstash, Pinecone & Replicate API.☆17Aug 30, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Pytorch version of FPN on the VisDrone Dataset☆10Jul 21, 2020Updated 6 years ago
- ☆17Jan 10, 2026Updated 8 months ago
- avrateNG -- next generation of avrate☆30Jul 29, 2026Updated last month
- A clone of the Suno AI website UI using NextJS and Tailwind☆18May 27, 2024Updated 2 years ago
- This Repo. is used for our ACM MM2023 paper: Recurrent Multi-scale Transformer for High-Resolution Salient Object Detection☆34Sep 12, 2023Updated 3 years ago
- 💧 Monitoring water tanker level using NodeMCU ESP8266 and HC-SR04P Ultrasonic Sensor and broadcasting it using a simple HTTP server insi…☆21Oct 1, 2022Updated 3 years ago
- 用大模型批量处理数据，现 支持各种大模型做OCR，支持通义千问, 月之暗面, 百度飞桨OCR, OpenAI 和LLAVA。Use LLM to generate or clean data for academic use. Support OCR with qwen, m…☆18Sep 15, 2024Updated 2 years ago