cubist38 / mlx-server-OAI-compat

A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI framework, it provides an efficient, scalable, and user-friendly solution for running MLX-based vision and language models locally with an OpenAI-compatible interface.
β˜†32Updated this week

Alternatives and similar repositories for mlx-server-OAI-compat:

Users that are interested in mlx-server-OAI-compat are comparing it to the libraries listed below