This is a FastAPI based LLM server. Load multiple LLM models (MLX or llama.cpp) simultaneously using multiprocessing.
☆20Apr 8, 2026Updated 6 months ago
Alternatives and similar repositories for mlx_gguf_server
Users that are interested in mlx_gguf_server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Automatically post images from a subreddit to an instagram account.☆10Feb 24, 2022Updated 4 years ago
- A simple SwiftUI ViewModifier to add a card-like background to a View.☆11Oct 28, 2019Updated 6 years ago
- Accelerating GOT-OCRv2 with VLLM☆10Nov 15, 2024Updated last year
- Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.☆30Mar 15, 2025Updated last year
- An animated card menu built with SwiftUI☆10Apr 17, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆12Sep 5, 2021Updated 5 years ago
- Astro SSG🚀 + Firebase🔥☆11Jan 10, 2024Updated 2 years ago
- Scripts and tools for optimizing quantizations in llama.cpp with GGUF imatrices.☆19Jan 10, 2025Updated last year
- ☆21Jun 25, 2026Updated 3 months ago
- A chatbot demo app using Huggingface inference API, React Native, Expo, and Redux Saga. Build for Android, iOS, and Web.☆13Dec 7, 2022Updated 3 years ago
- separating music and voice from a song☆10Nov 29, 2018Updated 7 years ago
- 山东省第二届数据应用创新创业大赛-主赛场-检验报告单识别-Baseline☆13Jan 15, 2021Updated 5 years ago
- ☆15Aug 19, 2023Updated 3 years ago
- Open source video parser for the ITU-T P.1204.3 model.☆22Jul 8, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Social Media Marketing Service Tool website like smmpanel.net, built with REACT JS☆12Feb 24, 2024Updated 2 years ago
- 🍕 Food Ordering iOS application.☆18Mar 8, 2024Updated 2 years ago
- Add a Carousel to SwiftUI☆16Nov 7, 2021Updated 4 years ago
- A swarm of LLM agents that will help you test, document, and productionize your code!☆20Updated this week
- 🖼️🤖 302 Vector Graphics Generation! 🚀✨☆22Aug 26, 2025Updated last year
- .NET SDK for Azure OpenAI platform☆15Feb 14, 2023Updated 3 years ago
- Swift implementation of OpenAI's GPT-3 api☆18Dec 30, 2020Updated 5 years ago
- ☆18May 10, 2025Updated last year
- This is new python code editor for begginers with script run ability and with hot keys. And with Open AI GPT-4 (Llama 3.2) model assistan…☆19Mar 15, 2026Updated 6 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Personalized Virtual Webcam for WebRTC☆19Aug 5, 2026Updated 2 months ago
- A chatbot with IBM Voice Gateway which enables direct voice interactions over a telephone with an artificial intelligence (AI) selfservic…☆20Sep 16, 2019Updated 7 years ago
- AutismX is an app that helps non-verbal kids to communicate. Using a lot of activites. Using this app, you can take a test and answer few…☆21Jan 25, 2023Updated 3 years ago
- AI SaaS Companion with Next.js 13, React, Tailwind, Prisma, Stripe, PlanetScale, Upstash, Pinecone & Replicate API.☆17Aug 30, 2024Updated 2 years ago
- A clone of the Suno AI website UI using NextJS and Tailwind☆18May 27, 2024Updated 2 years ago
- Waffer-thin FlaskGPT on Vercel.☆12Jun 1, 2023Updated 3 years ago
- 💧 Monitoring water tanker level using NodeMCU ESP8266 and HC-SR04P Ultrasonic Sensor and broadcasting it using a simple HTTP server insi…☆21Oct 1, 2022Updated 4 years ago
- 🚀 Welcome to the YouTube Data Analysis and Insights project! 📊☆19Sep 21, 2023Updated 3 years ago
- 用大模型批量处理数据，现支持各种大模型做OCR，支持通义千问, 月之暗面, 百度飞桨OCR, OpenAI 和LLAVA。Use LLM to generate or clean data for academic use. Support OCR with qwen, m…☆18Sep 15, 2024Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Vision Rag with Jina CLIP V2, ColPali - ColQwen, Qdrant, Gemini Flash☆23Jan 1, 2025Updated last year
- Rust bindings for CTranslate2☆14Jun 21, 2023Updated 3 years ago
- An OpenAI DALLE2 App - Made with SwiftUI☆21Apr 5, 2023Updated 3 years ago
- FullStack Learing Platform | Next.js 13 | React | Stripe | Mux | Prisma | Tailwind | MongoDB | Shadcn/ui | Stripe | UploadThing☆21Dec 13, 2023Updated 2 years ago
- Made with Coingecko API, this is a VERY simple python script that asks you the crypto, date and currency you want and then proceeds to gi…☆15Jun 24, 2022Updated 4 years ago
- Test your local LLMs on the AIME problems☆39Jun 7, 2025Updated last year
- ☆17May 23, 2021Updated 5 years ago