Alternatives and similar repositories for mlx-openai-server

Users that are interested in mlx-openai-server are comparing it to the libraries listed below

• arcee-ai / fastmlx
  FastMLX is a high performance production ready API to host MLX models.
  ☆339Updated 9 months ago
• Blaizzy / mlx-embeddings
  MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.
  ☆244Updated 2 months ago
• Goekdeniz-Guelmez / mlx-lm-lora
  Train Large Language Models on MLX.
  ☆239Updated last month
• JosefAlbers / Phi-3-Vision-MLX
  Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon
  ☆274Updated 2 months ago
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆99Updated 6 months ago
• mzau / mlx-knife
  ollama like cli tool for MLX models on huggingface (pull, rm, list, show, serve etc.)
  ☆121Updated this week
• priontific / MLX-text-completion-notebook
  A simple Jupyter Notebook for learning MLX text-completion fine-tuning!
  ☆122Updated last year
• RamboRogers / mlx-gui
  MLX-GUI MLX Inference Server for Apple Silicone
  ☆162Updated 3 weeks ago
• ivanfioravanti / qwen-image-mps
  Qwen Image models through MPS
  ☆249Updated last week
• madroidmaq / mlx-omni-server
  MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. I…
  ☆631Updated 2 weeks ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆99Updated last year
• kspviswa / pyOllaMx
  Your gateway to both Ollama & Apple MlX models
  ☆150Updated 10 months ago
• mzbac / mlx-llm-server
  For inferring and serving local LLMs using the MLX framework
  ☆109Updated last year
• armbues / SiLLM
  SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.
  ☆286Updated 6 months ago
• vegaluisjose / mlx-rag
  Explore a simple example of utilizing MLX for RAG application running locally on your Apple Silicon device.
  ☆179Updated last year
• transformerlab / transformerlab-api
  API Server for Transformer Lab
  ☆82Updated last month
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆241Updated last year
• codelion / ellora
  Enhancing LLMs with LoRA
  ☆204Updated 2 months ago
• Doriandarko / MLX-GRPO
  A pure MLX-based training pipeline for fine-tuning LLMs using GRPO on Apple Silicon.
  ☆223Updated 2 months ago
• jina-ai / mlx-retrieval
  Train embedding and reranker models for retrieval tasks on Apple Silicon with MLX
  ☆172Updated 3 months ago
• mustafaaljadery / mlxserver
  Start a server from the MLX library.
  ☆196Updated last year
• senstella / csm-mlx
  An implementation of the CSM(Conversation Speech Model) for Apple Silicon using MLX.
  ☆392Updated 4 months ago
• ivanfioravanti / lmstudio_hf
  A command-line utility to manage MLX models between your Hugging Face cache and LM Studio.
  ☆73Updated 2 months ago
• Goekdeniz-Guelmez / mlx-lm-lens
  Find the hidden meaning of LLMs
  ☆38Updated last month
• qnguyen3 / docpixie
  Lightweight Vision native Multimodal Document Agent
  ☆154Updated 4 months ago
• firstbatchxyz / dria-agent
  powerful and fast tool calling agents
  ☆79Updated 9 months ago
• apeatling / simple-guide-to-mlx-finetuning
  Generate train.jsonl and valid.jsonl files to use for fine-tuning Mistral and other LLMs.
  ☆96Updated last year
• kspviswa / PyOMlx
  A wannabe Ollama equivalent for Apple MlX models
  ☆81Updated 10 months ago
• cavit99 / mlx-LLM-cheatsheet
  This repo maintains a 'cheat sheet' for LLMs that are undertrained on mlx
  ☆18Updated 9 months ago
• OoriData / Toolio
  GenAI & agent toolkit for Apple Silicon Mac, implementing JSON schema-steered structured output (3SO) and tool-calling in Python. For mor…
  ☆130Updated last month