Alternatives and similar repositories for mlx-engine

Users that are interested in mlx-engine are comparing it to the libraries listed below

• madroidmaq / mlx-omni-server
  MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. I…
  ☆656Updated last month
• Blaizzy / mlx-vlm
  MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
  ☆2,067Updated this week
• arcee-ai / fastmlx
  FastMLX is a high performance production ready API to host MLX models.
  ☆341Updated 10 months ago
• argmaxinc / DiffusionKit
  On-device Image Generation for Apple Silicon
  ☆684Updated 9 months ago
• riccardomusmeci / mlx-llm
  Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.
  ☆458Updated last year
• ml-explore / mlx-lm
  Run LLMs with MLX
  ☆3,492Updated this week
• Blaizzy / mlx-embeddings
  MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.
  ☆263Updated 2 weeks ago
• TristanBilot / mlx-benchmark
  Benchmark of Apple MLX operations on all Apple Silicon chips (GPU, CPU) + MPS and CUDA.
  ☆214Updated 3 weeks ago
• johnmai-dev / ChatMLX
  🤖✨ChatMLX is a modern, open-source, high-performance chat application for MacOS based on large language models.
  ☆815Updated 10 months ago
• Trans-N-ai / swama
  High-performance MLX-based LLM inference engine for macOS with native Swift implementation
  ☆476Updated 2 weeks ago
• PicoMLX / PicoMLXServer
  The easiest way to run the fastest MLX-based LLMs locally
  ☆308Updated last year
• HazyResearch / minions
  Big & Small LLMs working together
  ☆1,258Updated this week
• armbues / SiLLM
  SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.
  ☆284Updated 7 months ago
• antranapp / awesome-mlx
  ☆196Updated 10 months ago
• kspviswa / pyOllaMx
  Your gateway to both Ollama & Apple MlX models
  ☆149Updated 11 months ago
• huggingface / chat-macOS
  Making the community's best AI chat models available to everyone.
  ☆1,982Updated 11 months ago
• mustafaaljadery / lightning-whisper-mlx
  An extremely fast implementation of whisper optimized for Apple Silicon using MLX.
  ☆867Updated last year
• allenai / OLMoE.swift
  ☆307Updated 9 months ago
• da-z / mlx-ui
  A simple UI / Web / Frontend for MLX mlx-lm using Streamlit.
  ☆260Updated 3 months ago
• ml-explore / mlx-data
  Efficient framework-agnostic data loading
  ☆458Updated 4 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆245Updated last year
• senstella / csm-mlx
  An implementation of the CSM(Conversation Speech Model) for Apple Silicon using MLX.
  ☆394Updated 5 months ago
• vllm-project / vllm-metal
  Community maintained hardware plugin for vLLM on Apple Silicon
  ☆349Updated this week
• ggml-org / llama.vscode
  VS Code extension for LLM-assisted code/text completion
  ☆1,139Updated 2 weeks ago
• lmstudio-ai / lmstudio-python
  LM Studio Python SDK
  ☆750Updated 3 months ago
• JosefAlbers / PVM
  Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon
  ☆273Updated 2 months ago
• Goekdeniz-Guelmez / mlx-lm-lora
  Train Large Language Models on MLX.
  ☆245Updated this week
• senstella / parakeet-mlx
  An implementation of the Nvidia's Parakeet models for Apple Silicon using MLX.
  ☆790Updated 3 weeks ago
• cubist38 / mlx-openai-server
  A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI…
  ☆203Updated this week
• philipturner / metal-flash-attention
  FlashAttention (Metal Port)
  ☆577Updated last year