Alternatives and similar repositories for mlx-engine

Users that are interested in mlx-engine are comparing it to the libraries listed below

• ml-explore / mlx-lm
  Run LLMs with MLX
  ☆1,276Updated this week
• madroidmaq / mlx-omni-server
  MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. I…
  ☆437Updated this week
• arcee-ai / fastmlx
  FastMLX is a high performance production ready API to host MLX models.
  ☆311Updated 3 months ago
• Blaizzy / mlx-vlm
  MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
  ☆1,470Updated this week
• riccardomusmeci / mlx-llm
  Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.
  ☆447Updated 5 months ago
• armbues / SiLLM
  SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.
  ☆273Updated 3 weeks ago
• PicoMLX / PicoMLXServer
  The easiest way to run the fastest MLX-based LLMs locally
  ☆288Updated 8 months ago
• antranapp / awesome-mlx
  ☆179Updated 3 months ago
• argmaxinc / DiffusionKit
  On-device Image Generation for Apple Silicon
  ☆632Updated 3 months ago
• johnmai-dev / ChatMLX
  🤖✨ChatMLX is a modern, open-source, high-performance chat application for MacOS based on large language models.
  ☆794Updated 4 months ago
• TristanBilot / mlx-benchmark
  Benchmark of Apple MLX operations on all Apple Silicon chips (GPU, CPU) + MPS and CUDA.
  ☆189Updated last month
• Blaizzy / mlx-embeddings
  MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.
  ☆177Updated last month
• mustafaaljadery / lightning-whisper-mlx
  An extremely fast implementation of whisper optimized for Apple Silicon using MLX.
  ☆741Updated last year
• Trans-N-ai / swama
  High-performance MLX-based LLM inference engine for macOS with native Swift implementation
  ☆286Updated this week
• da-z / mlx-ui
  A simple UI / Web / Frontend for MLX mlx-lm using Streamlit.
  ☆257Updated last month
• JosefAlbers / Phi-3-Vision-MLX
  Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon
  ☆271Updated 10 months ago
• kspviswa / pyOllaMx
  Your gateway to both Ollama & Apple MlX models
  ☆138Updated 4 months ago
• vegaluisjose / mlx-rag
  Explore a simple example of utilizing MLX for RAG application running locally on your Apple Silicon device.
  ☆171Updated last year
• senstella / csm-mlx
  An implementation of the CSM(Conversation Speech Model) for Apple Silicon using MLX.
  ☆364Updated last month
• filipstrand / mflux
  A MLX port of FLUX based on the Huggingface Diffusers implementation.
  ☆1,463Updated last week
• allenai / OLMoE.swift
  ☆292Updated 2 months ago
• mustafaaljadery / mlxserver
  Start a server from the MLX library.
  ☆188Updated 11 months ago
• ml-explore / mlx-data
  Efficient framework-agnostic data loading
  ☆427Updated last month
• anurmatov / mac-studio-server
  Optimized Ollama LLM server configuration for Mac Studio and other Apple Silicon Macs. Headless setup with automatic startup, resource op…
  ☆203Updated 4 months ago
• RayFernando1337 / LLM-Calc
  Instantly calculate the maximum size of quantized language models that can fit in your available RAM, helping you optimize your models fo…
  ☆228Updated 2 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆198Updated last year
• johnmai-dev / NotebookMLX
  📋 NotebookMLX - An Open Source version of NotebookLM (Ported NotebookLlama)
  ☆303Updated 4 months ago
• senstella / parakeet-mlx
  An implementation of the Nvidia's Parakeet models for Apple Silicon using MLX.
  ☆357Updated last week
• Anemll / Anemll
  Artificial Neural Engine Machine Learning Library
  ☆1,082Updated this week
• lmstudio-ai / lmstudio-python
  LM Studio Python SDK
  ☆537Updated this week