Alternatives and similar repositories for mlx-engine

Users that are interested in mlx-engine are comparing it to the libraries listed below

• madroidmaq / mlx-omni-server
  MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. I…
  ☆634Updated 3 weeks ago
• Blaizzy / mlx-vlm
  MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
  ☆1,987Updated last week
• arcee-ai / fastmlx
  FastMLX is a high performance production ready API to host MLX models.
  ☆335Updated 9 months ago
• ml-explore / mlx-lm
  Run LLMs with MLX
  ☆3,271Updated this week
• riccardomusmeci / mlx-llm
  Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.
  ☆459Updated 11 months ago
• argmaxinc / DiffusionKit
  On-device Image Generation for Apple Silicon
  ☆683Updated 9 months ago
• Blaizzy / mlx-embeddings
  MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.
  ☆246Updated this week
• Anemll / Anemll
  Artificial Neural Engine Machine Learning Library
  ☆1,295Updated 2 weeks ago
• armbues / SiLLM
  SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.
  ☆284Updated 7 months ago
• PicoMLX / PicoMLXServer
  The easiest way to run the fastest MLX-based LLMs locally
  ☆306Updated last year
• TristanBilot / mlx-benchmark
  Benchmark of Apple MLX operations on all Apple Silicon chips (GPU, CPU) + MPS and CUDA.
  ☆209Updated last week
• johnmai-dev / ChatMLX
  🤖✨ChatMLX is a modern, open-source, high-performance chat application for MacOS based on large language models.
  ☆812Updated 10 months ago
• antranapp / awesome-mlx
  ☆194Updated 9 months ago
• kspviswa / pyOllaMx
  Your gateway to both Ollama & Apple MlX models
  ☆149Updated 10 months ago
• Trans-N-ai / swama
  High-performance MLX-based LLM inference engine for macOS with native Swift implementation
  ☆463Updated last week
• JosefAlbers / Phi-3-Vision-MLX
  Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon
  ☆273Updated 2 months ago
• allenai / OLMoE.swift
  ☆307Updated 9 months ago
• senstella / csm-mlx
  An implementation of the CSM(Conversation Speech Model) for Apple Silicon using MLX.
  ☆392Updated 5 months ago
• senstella / parakeet-mlx
  An implementation of the Nvidia's Parakeet models for Apple Silicon using MLX.
  ☆758Updated last week
• lmstudio-ai / lmstudio-python
  LM Studio Python SDK
  ☆731Updated 2 months ago
• ivanfioravanti / qwen-image-mps
  Qwen Image models through MPS
  ☆249Updated 2 weeks ago
• mustafaaljadery / lightning-whisper-mlx
  An extremely fast implementation of whisper optimized for Apple Silicon using MLX.
  ☆852Updated last year
• Goekdeniz-Guelmez / mlx-lm-lora
  Train Large Language Models on MLX.
  ☆240Updated this week
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆241Updated last year
• vegaluisjose / mlx-rag
  Explore a simple example of utilizing MLX for RAG application running locally on your Apple Silicon device.
  ☆178Updated last year
• ml-explore / mlx-data
  Efficient framework-agnostic data loading
  ☆455Updated 3 months ago
• HazyResearch / minions
  Big & Small LLMs working together
  ☆1,241Updated this week
• ggml-org / llama.vscode
  VS Code extension for LLM-assisted code/text completion
  ☆1,124Updated last week
• da-z / mlx-ui
  A simple UI / Web / Frontend for MLX mlx-lm using Streamlit.
  ☆260Updated 2 months ago
• philipturner / metal-flash-attention
  FlashAttention (Metal Port)
  ☆572Updated last year