Start a server from the MLX library.
☆199Jul 26, 2024Updated last year
Alternatives and similar repositories for mlxserver
Users that are interested in mlxserver are comparing it to the libraries listed below
Sorting:
- The easiest way to run the fastest MLX-based LLMs locally☆316Oct 30, 2024Updated last year
- mlx image models for Apple Silicon machines☆92Nov 30, 2025Updated 3 months ago
- FastMLX is a high performance production ready API to host MLX models.☆346Mar 18, 2025Updated 11 months ago
- For inferring and serving local LLMs using the MLX framework☆111Mar 24, 2024Updated last year
- A simple script to enhance text editing across your Mac, leveraging the power of MLX. Designed for seamless integration, it offers real-t…☆109Mar 4, 2024Updated 2 years ago
- SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.☆284Jun 16, 2025Updated 8 months ago
- Run large models from the terminal using Apple MLX.☆31Mar 18, 2024Updated last year
- ☆43Jun 27, 2025Updated 8 months ago
- huggingface chat-ui integration with mlx-lm server☆62Feb 13, 2024Updated 2 years ago
- A simple UI / Web / Frontend for MLX mlx-lm using Streamlit.☆260Oct 25, 2025Updated 4 months ago
- MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. I…☆673Dec 21, 2025Updated 2 months ago
- A multi-platform SwiftUI frontend for running local LLMs with Apple's MLX framework.☆431Oct 27, 2024Updated last year
- An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.☆38Jun 21, 2024Updated last year
- Minimal, clean code implementation of RAG with mlx using gguf model weights☆53Apr 27, 2024Updated last year
- Scripts to create your own moe models using mlx☆90Feb 26, 2024Updated 2 years ago
- An all-in-one LLMs Chat UI for Apple Silicon Mac using MLX Framework.☆1,586Sep 6, 2024Updated last year
- Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.☆459Jan 29, 2025Updated last year
- Chat with MLX is a high-performance macOS application that connects your local documents to a personalized large language model (LLM).☆178Mar 8, 2024Updated last year
- Gradio chat interface for FastMLX☆12Sep 22, 2024Updated last year
- MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.☆2,212Updated this week
- Examples in the MLX framework☆8,310Feb 12, 2026Updated 3 weeks ago
- A Next.js chatbot app demonstrating seamless integration with window.ai.☆15Jun 25, 2023Updated 2 years ago
- Transcribe and summarize videos using whisper and llms on apple mlx framework☆79Jan 28, 2024Updated 2 years ago
- On-device Image Generation for Apple Silicon☆691Apr 11, 2025Updated 10 months ago
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆101Jun 29, 2025Updated 8 months ago
- Explore a simple example of utilizing MLX for RAG application running locally on your Apple Silicon device.☆178Jan 31, 2024Updated 2 years ago
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆119May 22, 2024Updated last year
- ☆20Mar 10, 2024Updated last year
- OpenAI GPT hosted Agent Framework for Windows and MacOS☆36Jul 8, 2024Updated last year
- MLX Transformers is a library that provides model implementation in MLX. It uses a similar model interface as HuggingFace Transformers an…☆74Nov 19, 2024Updated last year
- ☆20Oct 25, 2025Updated 4 months ago
- Distributed Inference for mlx LLm☆100Aug 1, 2024Updated last year
- Generate train.jsonl and valid.jsonl files to use for fine-tuning Mistral and other LLMs.☆97Feb 5, 2024Updated 2 years ago
- MLX native implementations of state-of-the-art generative image models☆1,847Feb 27, 2026Updated last week
- A reinforcement learning framework based on MLX.☆249Dec 1, 2025Updated 3 months ago
- Implementation of nougat that focuses on processing pdf locally.☆84Jan 15, 2025Updated last year
- tiny_fnc_engine is a minimal python library that provides a flexible engine for calling functions extracted from a LLM.☆38Sep 11, 2024Updated last year
- Examples using MLX Swift☆2,438Jan 22, 2026Updated last month
- Clean RL implementation using MLX☆35Mar 8, 2024Updated last year