Alternatives and similar repositories for mlx-engine

Users that are interested in mlx-engine are comparing it to the libraries listed below

• arcee-ai / fastmlx
  FastMLX is a high performance production ready API to host MLX models.
  ☆342Updated 10 months ago
• Blaizzy / mlx-vlm
  MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
  ☆2,108Updated this week
• madroidmaq / mlx-omni-server
  MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. I…
  ☆661Updated last month
• riccardomusmeci / mlx-llm
  Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.
  ☆458Updated last year
• argmaxinc / DiffusionKit
  On-device Image Generation for Apple Silicon
  ☆687Updated 10 months ago
• Blaizzy / mlx-embeddings
  MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.
  ☆269Updated 3 weeks ago
• TristanBilot / mlx-benchmark
  Benchmark of Apple MLX operations on all Apple Silicon chips (GPU, CPU) + MPS and CUDA.
  ☆215Updated last month
• ml-explore / mlx-lm
  Run LLMs with MLX
  ☆3,577Updated this week
• armbues / SiLLM
  SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.
  ☆284Updated 7 months ago
• Trans-N-ai / swama
  High-performance MLX-based LLM inference engine for macOS with native Swift implementation
  ☆478Updated 3 weeks ago
• antranapp / awesome-mlx
  ☆197Updated 10 months ago
• Anemll / Anemll
  Artificial Neural Engine Machine Learning Library
  ☆1,314Updated this week
• johnmai-dev / ChatMLX
  🤖✨ChatMLX is a modern, open-source, high-performance chat application for MacOS based on large language models.
  ☆817Updated 10 months ago
• ml-explore / mlx-data
  Efficient framework-agnostic data loading
  ☆459Updated 4 months ago
• HazyResearch / minions
  Big & Small LLMs working together
  ☆1,261Updated this week
• PicoMLX / PicoMLXServer
  The easiest way to run the fastest MLX-based LLMs locally
  ☆310Updated last year
• kspviswa / pyOllaMx
  Your gateway to both Ollama & Apple MlX models
  ☆150Updated 11 months ago
• filipstrand / mflux
  MLX native implementations of state-of-the-art generative image models
  ☆1,807Updated this week
• da-z / mlx-ui
  A simple UI / Web / Frontend for MLX mlx-lm using Streamlit.
  ☆260Updated 3 months ago
• philipturner / metal-flash-attention
  FlashAttention (Metal Port)
  ☆579Updated last year
• cubist38 / mlx-openai-server
  A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI…
  ☆210Updated this week
• ggml-org / llama.vscode
  VS Code extension for LLM-assisted code/text completion
  ☆1,150Updated 3 weeks ago
• senstella / parakeet-mlx
  An implementation of the Nvidia's Parakeet models for Apple Silicon using MLX.
  ☆797Updated last month
• lmstudio-ai / lmstudio-python
  LM Studio Python SDK
  ☆754Updated 3 months ago
• vllm-project / vllm-metal
  Community maintained hardware plugin for vLLM on Apple Silicon
  ☆400Updated this week
• Goekdeniz-Guelmez / mlx-lm-lora
  Train Large Language Models on MLX.
  ☆258Updated this week
• senstella / csm-mlx
  An implementation of the CSM(Conversation Speech Model) for Apple Silicon using MLX.
  ☆396Updated 5 months ago
• mustafaaljadery / lightning-whisper-mlx
  An extremely fast implementation of whisper optimized for Apple Silicon using MLX.
  ☆867Updated last year
• huggingface / chat-macOS
  Making the community's best AI chat models available to everyone.
  ☆1,979Updated last year
• JosefAlbers / PVM
  Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon
  ☆273Updated 3 months ago