This is a FastAPI based LLM server. Load multiple LLM models (MLX or llama.cpp) simultaneously using multiprocessing.
☆19Apr 8, 2026Updated 7 months ago
Alternatives and similar repositories for mlx_gguf_server
Users that are interested in mlx_gguf_server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A simple SwiftUI ViewModifier to add a card-like background to a View.☆11Oct 28, 2019Updated 7 years ago
- An animated card menu built with SwiftUI☆10Apr 17, 2023Updated 3 years ago
- Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.☆30Mar 15, 2025Updated last year
- Fully automated whiteboard animation using Python, OpenCV and PyAutoGUI☆10Jul 4, 2021Updated 5 years ago
- ☆21Jun 25, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- In this course you'll learn to use Gradio to create user-friendly apps with minimal code: Summarize text using a large language model, ge…☆15Nov 15, 2023Updated 3 years ago
- Examples in the MLX framework☆11Sep 23, 2024Updated 2 years ago
- A chatbot demo app using Huggingface inference API, React Native, Expo, and Redux Saga. Build for Android, iOS, and Web.☆13Dec 7, 2022Updated 3 years ago
- separating music and voice from a song☆10Nov 29, 2018Updated 7 years ago
- DeepDialogue: A Multi-Turn Emotionally-Rich Spoken Dialogue Dataset (code for SER Task)☆11May 28, 2025Updated last year
- The deep learning researcher's starter kit☆10Nov 2, 2026Updated 2 weeks ago
- a gguf model runner☆18Updated this week
- ☆12Sep 26, 2024Updated 2 years ago
- MLX implementation of GCN, with benchmark on MPS, CUDA and CPU (M1 Pro, M2 Ultra, M3 Max).☆25Dec 16, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A repository that contains different basic design templates for open-source graphics software like GIMP, Scribus, Inkscape, Synfig and Bl…☆11Oct 18, 2022Updated 4 years ago
- PyTorch Implementation of Attention Prompt Tuning: Parameter-Efficient Adaptation of Pre-Trained Models for Action Recognition☆15Mar 12, 2024Updated 2 years ago
- ✍️🤖 302 AI Paper Writing! 🚀✨☆14Aug 25, 2025Updated last year
- A SwiftUI-based Music Player inspired by the popular website Suno AI, showcasing modern iOS app development techniques. This was just a p…☆15Nov 16, 2024Updated 2 years ago
- Website for members of non-profit community groups to manage their membership, services and subscriptions. Easily extensible with plugins…☆11Feb 21, 2019Updated 7 years ago
- Hermes Skill Pack for structured AI video production on HyperFrames — brief → storyboard → HTML → lint/render.☆17May 23, 2026Updated 5 months ago
- ☆12Oct 28, 2023Updated 3 years ago
- Handles everything related to working with instruction datasets☆11Dec 19, 2023Updated 2 years ago
- AI SaaS Companion with Next.js 13, React, Tailwind, Prisma, Stripe, PlanetScale, Upstash, Pinecone & Replicate API.☆17Aug 30, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Rust bindings for CTranslate2☆14Jun 21, 2023Updated 3 years ago
- LSL Integration for Wearable Sensing EEG Hardware☆10Aug 2, 2025Updated last year
- A clone of the Suno AI website UI using NextJS and Tailwind☆18May 27, 2024Updated 2 years ago
- 📷🤖 AI Talking Photo 🚀✨☆16Aug 26, 2025Updated last year
- ☆17May 23, 2021Updated 5 years ago
- Safe-by-design USDC and x402 payment plugin for Hermes Agent☆14Mar 20, 2026Updated 7 months ago
- Platform independent command-line application to stream data from Unicorn EEG system.☆14Oct 22, 2023Updated 3 years ago
- A swarm of LLM agents that will help you test, document, and productionize your code!☆20Oct 26, 2026Updated 3 weeks ago
- A media buyer brain for your Hermes agent: research competitors, build image + video ads with Arcads, write human-sounding copy, launch t…☆18Sep 3, 2026Updated 2 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Unofficial X API using Selenium☆14Jan 10, 2025Updated last year
- Waffer-thin FlaskGPT on Vercel.☆12Jun 1, 2023Updated 3 years ago
- The benchmark experiments of paper "ReSGait: The real scene gait dataset".☆12Jul 25, 2024Updated 2 years ago
- A python instagram selenium bot that likes the stories of users that will get from a txt file.☆19Dec 1, 2023Updated 2 years ago
- AutismX is an app that helps non-verbal kids to communicate. Using a lot of activites. Using this app, you can take a test and answer few…☆21Jan 25, 2023Updated 3 years ago
- LiquidAI fuses cutting-edge AI models with blockchain data to deliver real-time insights, predictive analytics, and ecosystem intelligenc…☆13Apr 27, 2025Updated last year
- ☆18May 10, 2025Updated last year
Are these results useful?